-- Logs begin at Tue 2022-05-24 08:33:52 UTC, end at Tue 2022-05-24 09:19:59 UTC. -- May 24 09:01:42.417046 dv-cinder-843118-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 24 09:01:42.426821 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 09:01:42 2022] *** May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: nodename: dv-cinder-843118-1-iscsi May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: machine: x86_64 May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: clock source: unix May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: pcre jit disabled May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: detected number of CPU cores: 4 May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: current working directory: / May 24 09:01:42.428831 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: detected binary path: /usr/bin/uwsgi-core May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: your processes number limit is 47680 May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: your memory page size is 4096 bytes May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: detected max file descriptor number: 2048 May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: lock engine: pthread robust mutexes May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: thunder lock: enabled May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 24 09:01:42.429471 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 09:01:42.474304 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: Python main interpreter initialized at 0x557970e199c0 May 24 09:01:42.474304 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: python threads support enabled May 24 09:01:42.474304 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: your server socket listen backlog is limited to 100 connections May 24 09:01:42.474304 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: your mercy for graceful operations on workers is 90 seconds May 24 09:01:42.474642 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: mapped 403077 bytes (393 KB) for 2 cores May 24 09:01:42.474743 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: *** Operational MODE: preforking *** May 24 09:01:42.475018 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: *** uWSGI is running in multiple interpreter mode *** May 24 09:01:42.475018 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: spawned uWSGI master process (pid: 80379) May 24 09:01:42.475206 dv-cinder-843118-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 24 09:01:42.478022 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: spawned uWSGI worker 1 (pid: 80387, cores: 1) May 24 09:01:42.478022 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: spawned uWSGI worker 2 (pid: 80388, cores: 1) May 24 09:01:42.478022 dv-cinder-843118-1-iscsi devstack@keystone.service[80379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 09:01:48.164253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:01:48.164253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: from cryptography.utils import int_from_bytes May 24 09:01:48.165020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:01:48.165020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: from cryptography.utils import int_from_bytes May 24 09:01:48.214412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:01:48.214412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: from cryptography.utils import int_from_bytes May 24 09:01:48.214984 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:01:48.214984 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: from cryptography.utils import int_from_bytes May 24 09:01:48.215097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:01:48.215097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:01:48.215204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] command line args: [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:01:48.215405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:01:48.215582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ================================================================================ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:01:48.215958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] admin_token = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.216205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_dir = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.216393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.216574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_source = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.216754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] debug = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.216952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.217442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.217529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.217735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.218006 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.218239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.218418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_config_append = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.218595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.218813 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_dir = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.218933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.219167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.219416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.219662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.219908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.220086 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.220265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.220509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.220756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.220990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.221223 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.221456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.221689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.221967 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.222214 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.222491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.222978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.223160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] publish_errors = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.223392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.223620 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.223798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.224043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.224277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.224509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] standard_threads = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.224739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.224979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.225155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.225330 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_journal = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.225504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_json = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.225678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_stderr = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.225853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_syslog = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.226110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.226367 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.226607 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.226866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.227104 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.227351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.227586 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.227831 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.228066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.228311 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.228557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.228806 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.229040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.229285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.229522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.229767 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.230034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.230273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.230527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.230780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.231026 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.231782 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.232032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.232320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.232630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.232883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.233117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.233350 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.233582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.233817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.234108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.234358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.234589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.234820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.235067 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.235314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.235549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.235797 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.236028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.236264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.236499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.236729 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.236960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.237190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.237421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.237658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.237932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.238156 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.238392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.238622 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.238857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.239092 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.239338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.239572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.239808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.240043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.240277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.240513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.240748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.240977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.241224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.241458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.241693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.241947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.242200 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.242442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.242676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.242912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.243149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.243415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.243652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.243899 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.244142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.244378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.244612 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.244847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.245094 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.245331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.245566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.245808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.246065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.246302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.246536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.246769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.247693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.248028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.248275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.248518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.248756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.249001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.249239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.249475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.249710 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.249959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.250209 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.250423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.250657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.250885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.251123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.251358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.251603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.251838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.252091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.252355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.252594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.252826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.external = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.253055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.253349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.253578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.253808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.password = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.254058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.token = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.254297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.254530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.254776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.255006 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.255251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.255496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.255728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.255964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.256212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.256463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.256712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.256950 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.257194 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.257430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.257698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.257975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.258217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.258470 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.258756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.259000 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.259264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.259507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.259761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.259995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.260231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.260478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.260724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.260954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.261200 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.261437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.261688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.261800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:01:48.261951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.262049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:01:48.262197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] command line args: [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:01:48.262291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.262437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.262728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:01:48.262728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ================================================================================ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:01:48.262920 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.263016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] admin_token = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.263228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config_dir = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.263409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.263513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.263600 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.263758 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config_source = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.263838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.263919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] debug = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.263919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.264135 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.264214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.264331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.264456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.264538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.264657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.264732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.264847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.264922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.265004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.265076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.265212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_config_append = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.265328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.265416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.265534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_dir = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.265617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.265749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.265866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.265973 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.266046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.266186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.266269 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.266433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.266523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.266675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.266760 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.266839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.266935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.267024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.267185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.267271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.267455 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.267534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.267694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.267774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.267921 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.268002 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.268149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.268229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.268376 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.268454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.268604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.268683 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.268838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.268919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.269079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.269159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.269318 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.269564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.269641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.269749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] publish_errors = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.269828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.270001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.270084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.270227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.270386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.270464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.270541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.270634 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.270734 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.270864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.270981 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.271092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] standard_threads = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.271209 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.271319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.271446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.271556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.271675 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.271761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.271887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_journal = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.271965 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.272059 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_json = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.272138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.272217 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_stderr = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.272363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.272454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_syslog = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.272600 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:01:48.272678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.272833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.272911 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273173 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.273866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274596 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.274986 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275216 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.275918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276163 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276858 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.276931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277313 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277579 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.277829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278870 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.278951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279406 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279557 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.279880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280270 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280733 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.280969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.281995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282470 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.282932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283083 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283558 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.283860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284014 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284462 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284542 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.284934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285059 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285378 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285631 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.285879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286060 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286140 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286292 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286375 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286758 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.286987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287220 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287447 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.287924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288003 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288383 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288879 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.288958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289118 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.289923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.290969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.291930 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292161 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.292970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.293129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.293210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.293359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.293446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.293595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.293673 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.294374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.294458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.294635 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.294780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.294866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.294938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295533 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295844 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.295991 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.296928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297008 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297507 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.external = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.297976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.298134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.298227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.298637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.298722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.298875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.298955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.password = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.token = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299801 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.299883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300043 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300270 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300357 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.300844 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301037 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.301828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.302956 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303685 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.303995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304239 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304627 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.304939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.305083 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:01:48.305160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.305361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.305608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.305852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.306108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.306353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.306589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.306840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.307074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.307325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.307558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.307799 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.308031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.308276 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.308520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.308754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.308988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.309232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.309510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.309747 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.310016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.310265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.310495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.310722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.310948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.311190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.311432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.311675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.311925 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.312169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.312435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.312669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.312903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.313129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.313365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.313592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.313823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.314157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.314399 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.314644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.314871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.315115 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.315358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.315588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.315830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.316072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.316298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.316530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.316797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.317151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.317504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.317862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.318244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.318593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.318956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.319319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.319639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.319963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.320327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.320689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.321039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.321387 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.321735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.322077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.322474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.322886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.323209 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.323464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.323708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.323953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.324185 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.324412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.324644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.324874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.325734 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.326323 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.326714 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.326973 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.327226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.327477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.327724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.327955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.328205 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.328442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.328679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.328915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.329151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.329395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.329642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.329876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.330165 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.330396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.330636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.330869 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.331103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.331337 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.331580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.331818 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.332045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.332279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.332514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.332759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.333005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.333237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.333482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.333727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.333985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.334231 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.334463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.334698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.334928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.335172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.335408 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.335651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.335895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.336138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.336370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.336518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.336652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.336779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.336904 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.337031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.337155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.337286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.337514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.337755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.338055 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.338302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.338545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.338946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.339180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.339426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.339672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.339915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.340159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.340390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.341245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.341532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.341923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.342173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.342407 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.342638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.342887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.343140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.343385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.343619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.343851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.344086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.344321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.344554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.344798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.345031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.345283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.345526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.345760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.345983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.346127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.346253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.346488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.346719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.346952 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.347181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.347421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.347664 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.347888 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.348124 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.348420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.348688 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.348938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.349184 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.349419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.349655 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.350018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.350257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.350493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.350725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.350968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.351201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.351441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.351675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.351920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.352151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.352391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.352617 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.352852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.353082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:01:48.353248 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:01:48.374697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.374928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.378252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.378483 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.378705 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.389031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.407298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.407522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.427439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.444664 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.478525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.478761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.482491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.482725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.543885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544213 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544340 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.544917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.545043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.545179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.545307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.545443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.568968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.569451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.569726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.569872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570153 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.570959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.571179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.571324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.582022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.582124 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.595869 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596089 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.596666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:01:48.613893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.614027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.614133 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:01:48.614217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:01:48.614469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.614555 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.614669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:01:48.614753 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:01:48.614933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615271 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615692 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.615781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.627454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.627727 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.627990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.628267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.628848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.629121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.629386 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.629665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.636453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.637819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.639920 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.640203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.640484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.640766 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.641049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.641142 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.641311 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.641394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.641631 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.641712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.641925 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.642857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.643095 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.643368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.643640 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.643906 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.670052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.671420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.671785 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.672060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.673124 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.673662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.677659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.677896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.678202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.678961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.679234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.679507 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.686113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.686392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.687346 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.687623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.690887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.691293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.691581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.691863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.692097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.692182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.692401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.692483 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.692674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.692756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.692943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.693028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.693263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.693530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.693793 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.694081 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.711729 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.712003 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.712661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.712933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.716796 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.717866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.720474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.720766 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.721530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.721821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.726020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.726892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.729637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.730550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.734003 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.734301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.734592 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.734812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.734896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.735106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.735270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.735394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.735478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.735688 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.735970 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.736253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.754518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.754798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.755064 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.755325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.755419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.755646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.755909 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.756167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.763938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.764837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.765649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.765956 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.766573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.766853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.769015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.769292 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.769572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.769860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.769967 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.770161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.770267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.770453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.770728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.770997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.783919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.784199 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.784481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.784765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.784857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.785045 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.785147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.785326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.785433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.785606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.785690 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.785932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.786179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.786458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.804811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.805440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.808116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.808774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.812084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.812712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.813696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.814370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.815365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.815657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.815935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.816017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.816252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.816535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.823417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.823959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.825056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.825643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.828532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.828824 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.828907 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.829106 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.829189 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.829382 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.829466 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.829722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.838572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.838858 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.838954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.839144 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.839225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.839523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.847299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.847509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:01:48.847594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.847784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.847866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848337 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848604 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.848969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849143 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.849956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850311 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850731 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.850988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:01:48.890998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557970e199c0 pid: 80387 (default app) May 24 09:01:48.891168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557970e199c0 pid: 80388 (default app) May 24 09:01:48.894213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a464fe-eb6b-44fb-8d8b-0d5de44f1f4b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:48.894508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a464fe-eb6b-44fb-8d8b-0d5de44f1f4b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:48.894782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a464fe-eb6b-44fb-8d8b-0d5de44f1f4b None None] PATH_INFO: `/v3` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:48.899039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue May 24 09:01:48 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:01:56.764978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:56.765557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:56.765557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:56.769960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:01:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:01:56.775160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:56.775586 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:56.775711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:56.843586 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: INFO dbcounter [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] Registered counter for database keystone May 24 09:01:56.865142 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG oslo_db.sqlalchemy.engines [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:01:56.871301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writer thread running {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 09:01:57.045059 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG passlib.handlers.bcrypt [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80387) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 24 09:01:57.045381 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG passlib.handlers.bcrypt [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80387) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 24 09:01:57.101545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:01:57.103238 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:01:57.228816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:01:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 24 09:01:57.267176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:01:57.341503 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: INFO dbcounter [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] Registered counter for database keystone May 24 09:01:57.362880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG oslo_db.sqlalchemy.engines [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:01:57.369075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writer thread running {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 09:01:57.490655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42102db-cbc6-42b9-82ad-5ad9a0194746 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:01:57.494847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:01:57.495519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:57.495803 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:57.496101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:57.504615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:01:57.558242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 24 09:01:57.558575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946e826-b574-453d-be0b-083a76e85f15 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:01:57.568493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue May 24 09:01:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 09:01:57.574508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:01:57.589174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ab34a-16bc-4665-8d82-ae15e958f29b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:01:57.594227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:01:57.595288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:57.595573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:57.595847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] PATH_INFO: `/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:57.597344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=80c3bd13a3974d42b6d3ecb6e6bc1a06)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:01:57.649495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 24 09:01:57.649839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf5855-4866-43c1-bee1-802c6e14f6e3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:01:57.655024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue May 24 09:01:57 2022] GET /identity/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:01:59.798974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc90b3-4c80-47e6-8a71-f288e0fa11f5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:59.799409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc90b3-4c80-47e6-8a71-f288e0fa11f5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:59.799530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc90b3-4c80-47e6-8a71-f288e0fa11f5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:59.803647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:01:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:01:59.809234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:59.809638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:59.809785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:59.828066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:01:59.829566 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:01:59.837206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:01:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 24 09:01:59.859326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc90b3-4c80-47e6-8a71-f288e0fa11f5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:01:59.871195 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc90b3-4c80-47e6-8a71-f288e0fa11f5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:01:59.875553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934699-4180-46b4-9337-c3ce0fd5ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:01:59.876181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934699-4180-46b4-9337-c3ce0fd5ec5a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:59.876467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934699-4180-46b4-9337-c3ce0fd5ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:59.876746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934699-4180-46b4-9337-c3ce0fd5ec5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:59.884371 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934699-4180-46b4-9337-c3ce0fd5ec5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:01:59.886187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934699-4180-46b4-9337-c3ce0fd5ec5a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:01:59.894939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue May 24 09:01:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 09:01:59.900234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:01:59.909711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ee2fc-f7f6-4307-9891-2af472c2dc13 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:01:59.914031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aa731-5a1f-4ac3-8e47-4d94fd59d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:01:59.914882 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aa731-5a1f-4ac3-8e47-4d94fd59d17f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:01:59.915164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aa731-5a1f-4ac3-8e47-4d94fd59d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:01:59.915438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aa731-5a1f-4ac3-8e47-4d94fd59d17f admin admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:01:59.916793 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aa731-5a1f-4ac3-8e47-4d94fd59d17f admin admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:01:59.919189 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aa731-5a1f-4ac3-8e47-4d94fd59d17f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:01:59.920716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue May 24 09:01:59 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:02.173812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5aad-7dfb-4939-9f26-e19fbb161aa0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.174340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5aad-7dfb-4939-9f26-e19fbb161aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.174422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5aad-7dfb-4939-9f26-e19fbb161aa0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.175748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:02.180802 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.181228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.181371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.198386 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:02.199623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:02.240235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfd28-4423-430b-a474-dea8af91ea03 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.240519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfd28-4423-430b-a474-dea8af91ea03 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.240800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfd28-4423-430b-a474-dea8af91ea03 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.242175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:02.247872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.248152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.248429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.279968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:02.287527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG passlib.handlers.bcrypt [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80388) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 24 09:02:02.287939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG passlib.handlers.bcrypt [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80388) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 24 09:02:02.303153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:02.328251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:02.336647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:02.338254 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:02.408976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e637-c811-4a7d-b41d-379b17fd33f3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:02.440177 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:02.444519 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:02.445322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.445612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.445891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.457013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:02.461621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:02.468636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:02.469654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:02.470731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:02.475891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:02.669845 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:02.677132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58ce7-1bc5-43cc-9441-df40afb0b292 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:02.679443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:02.689773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c048b8-ad21-4e5d-a5aa-46f2ce18beb5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:02.719407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:02.720241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.720537 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.720820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.724945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:02.725594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.725878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.726186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.726928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:02.727236 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:02.728625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:02.741169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:02.746669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:02.795130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:02.796678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:02.849212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f564e0e-8cf7-4923-b481-e01d6b6b5fae None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:02.883830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:02.884706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:02.884995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:02.885276 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:02.886522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:02.888128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:02.889767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 9/16] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:02 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:02.894196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:02:02.895065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:02.899400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:02.902092 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:02.910172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:02.995889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d355-f6bd-4f9e-b7e2-282c1c40b58b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:02.998355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977d1d-d38a-4545-8c86-553636e1a37e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:03.030054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:03.030870 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:03.031155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:03.031433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:03.031709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:03.032495 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:03.032588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:03.032780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:03.033060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:03.034094 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:03.035678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 10/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:03.041403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:03.052340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:03.053820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:02:03.074436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:03.075771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:03.076587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:02:03.076587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:02:03.076587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:02:03.076587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:03.076794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 9/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:03.082872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:03.123488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:03.140989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:03.144161 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcc792-57a7-4500-bfdf-18e6ae28e3a0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:03.178010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:03.178670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:03.178959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:03.179232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:03.180066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.domain.id=default, user.id=96d05461ca4045ab8fe2fd46023e1ef5) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:03.180376 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:03.181828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974efe94-6383-4102-9540-1f9ac3f1aa84 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:03.184554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27614e61-a85b-44a3-92f4-6be5994eff33 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:03.188630 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue May 24 09:02:03 2022] GET /identity/v3/role_assignments?user.id=96d05461ca4045ab8fe2fd46023e1ef5&scope.domain.id=default&role.id=08b7b51186384e71b433ea9c52d3430e => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:03.220740 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:03.221429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:03.221717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:03.222031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:03.222781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:03.223094 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:03.224544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b890-46f7-4674-b064-d8a53c2e3933 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:03.244029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:05.757538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a61ab-5cd5-495e-b6ea-be52611c69cc None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:05.758600 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a61ab-5cd5-495e-b6ea-be52611c69cc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:05.759121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a61ab-5cd5-495e-b6ea-be52611c69cc None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:05.760701 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:05.766749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:05.767683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:05.768161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:05.807847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:05.809491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:05.899768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:05.922771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a028-21bf-4b2b-b934-f7e0e76c1c2f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:05.923653 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a028-21bf-4b2b-b934-f7e0e76c1c2f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:05.924146 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423a028-21bf-4b2b-b934-f7e0e76c1c2f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:05.925718 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:05.930795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:05.935027 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f18a4-8b24-48fe-b7e1-f56af45529cf None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:05.935553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f18a4-8b24-48fe-b7e1-f56af45529cf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:05.936049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f18a4-8b24-48fe-b7e1-f56af45529cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:05.969579 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0c1f18a4-8b24-48fe-b7e1-f56af45529cf None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:05.971349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0c1f18a4-8b24-48fe-b7e1-f56af45529cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:06.060188 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:06.107789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:06.109601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc321a-c49e-4119-8b1e-bd41436b0776 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.110370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc321a-c49e-4119-8b1e-bd41436b0776 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.110825 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc321a-c49e-4119-8b1e-bd41436b0776 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.112453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 15/26] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:06.120135 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.120660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.121132 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.142565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:06.144062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:06.159063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4470-7f84-4c64-ba19-99e191928846 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.220881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 16/27] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:06.222127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:06.226009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:06.230621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:06.232023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.232375 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.233190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.248681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:06.250485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:02:06.269453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:06.270523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:06.271483 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:02:06.271483 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:02:06.271483 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:02:06.271483 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:06.273074 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 12/28] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:06.274022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:06.379039 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:06.383283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205bcab-e683-4337-813a-3af3ddff9f56 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.383699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbda7f-f950-43a5-8f37-df8e9e4c4500 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.420192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:06.421217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.421453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebe169-afc1-4f18-a232-bdc06f607579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:06.421842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.422298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.422405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe169-afc1-4f18-a232-bdc06f607579 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.422772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe169-afc1-4f18-a232-bdc06f607579 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.423467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebe169-afc1-4f18-a232-bdc06f607579 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.424405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebe169-afc1-4f18-a232-bdc06f607579 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:06.426026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebe169-afc1-4f18-a232-bdc06f607579 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:06.437792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:06.448040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:06.449093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:06.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:06.452833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 13/29] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:06.453961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:06.564839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 17/30] 10.222.0.30 () {60 vars in 1131 bytes} [Tue May 24 09:02:06 2022] POST /identity/v3/roles => generated 219 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:06.565104 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510fdcb-46eb-45bb-8e8e-71c26ae0126f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.566928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130647-7ca0-45b9-ae82-6e2f6421fc4f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.567297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130647-7ca0-45b9-ae82-6e2f6421fc4f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.567646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130647-7ca0-45b9-ae82-6e2f6421fc4f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.569210 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 18/31] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:06.570133 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130647-7ca0-45b9-ae82-6e2f6421fc4f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:06.606792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:06.607941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.608437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.608975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.610050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:06.610561 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:06.612195 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9096da0-7d5f-4752-97eb-d723fdf0fd82 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:06.634571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 14/32] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:06.636230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.636718 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.637923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.652220 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:06.673844 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:06.675108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:06.692107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:06.723296 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130647-7ca0-45b9-ae82-6e2f6421fc4f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.781677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 15/33] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:06.783552 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:06.793891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:06.794690 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.794977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.795310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.801948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:06.801948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:06.801948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:06.820619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 19/34] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:06.827488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:06.931050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31504f-784f-4034-be90-e1bfbc5b756f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.956961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f38da-dbf8-46ab-9fa5-2a69a6353ee9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:06.973216 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:06.974283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:06.974790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:06.975260 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:06.976608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:06.978341 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:06.987689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:07.001805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:07.003090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.003090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.003090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.004056 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:07.005473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:07.012644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:07.030537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 20/35] 10.222.0.30 () {60 vars in 1131 bytes} [Tue May 24 09:02:06 2022] POST /identity/v3/roles => generated 225 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:07.031566 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:07.132009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 16/36] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:02:06 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:07.193145 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf46a54-abed-4186-b76a-2042d8655838 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:07.235765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:07.236691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.236978 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.237260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.238746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:07.240308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:07.242627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 21/37] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:07 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:07.249241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:07.383428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfafad-a91d-44bc-b0ec-d41d62c8f69d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:07.430320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51977-0ba8-4891-b3f3-39b5c9a67cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:07.431151 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51977-0ba8-4891-b3f3-39b5c9a67cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.431438 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51977-0ba8-4891-b3f3-39b5c9a67cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.431717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51977-0ba8-4891-b3f3-39b5c9a67cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.433039 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51977-0ba8-4891-b3f3-39b5c9a67cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:07.435218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51977-0ba8-4891-b3f3-39b5c9a67cd8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:07.436890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 17/38] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:07.443112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:07.477953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed8478-2010-4ffe-99b0-24a7a288b627 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.478235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed8478-2010-4ffe-99b0-24a7a288b627 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.478462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed8478-2010-4ffe-99b0-24a7a288b627 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.479898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 18/39] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:07.486212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.486508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.486855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.506096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:07.507272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:07.507690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:07.570217 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b377c-5cf7-42f2-9c9e-1b49f787db6b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:07.586792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:07.594382 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:07.611164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f693f-7467-44a5-9b8e-d68919eceddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:07.612046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f693f-7467-44a5-9b8e-d68919eceddd None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.612335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f693f-7467-44a5-9b8e-d68919eceddd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.612615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f693f-7467-44a5-9b8e-d68919eceddd None admin] PATH_INFO: `/v3/domains/default/users/96d05461ca4045ab8fe2fd46023e1ef5/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.614756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f693f-7467-44a5-9b8e-d68919eceddd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=96d05461ca4045ab8fe2fd46023e1ef5, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:07.616294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f693f-7467-44a5-9b8e-d68919eceddd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:07.616843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:07.638006 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 22/41] 10.222.0.30 () {58 vars in 1361 bytes} [Tue May 24 09:02:07 2022] PUT /identity/v3/domains/default/users/96d05461ca4045ab8fe2fd46023e1ef5/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:07.739206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983df9cd-0d12-4de5-8191-0f38d3cac59e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:07.759645 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe5a3-ddc7-49aa-8e3d-538515cc4ea7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.759983 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe5a3-ddc7-49aa-8e3d-538515cc4ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.760224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe5a3-ddc7-49aa-8e3d-538515cc4ea7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.761620 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 23/42] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:07.767785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.768083 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.768364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.776856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:07.777646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:07.778890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:07.778890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:07.779649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:07.781086 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:07.787480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:07.790780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:07.810528 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 20/43] 10.222.0.30 () {60 vars in 1131 bytes} [Tue May 24 09:02:07 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:02:07.881859 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 24/44] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:07.906489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:07.986686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:08.038811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587b4e3-601e-467f-a26e-00ada5df1508 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:08.085283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abf057-d595-4361-a639-0e70f7b357df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:08.086143 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abf057-d595-4361-a639-0e70f7b357df None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:08.086431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abf057-d595-4361-a639-0e70f7b357df None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:08.086710 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abf057-d595-4361-a639-0e70f7b357df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:08.087938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abf057-d595-4361-a639-0e70f7b357df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:08.089408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abf057-d595-4361-a639-0e70f7b357df None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:08.091866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 21/45] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:08.098321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:08.152020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:08.219836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f670-9e2b-476c-a005-1e3126650969 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:08.256939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601511b7-7f63-4c22-b4a1-23a9f75cd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:08.257605 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601511b7-7f63-4c22-b4a1-23a9f75cd094 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:08.257917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601511b7-7f63-4c22-b4a1-23a9f75cd094 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:08.258214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601511b7-7f63-4c22-b4a1-23a9f75cd094 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:08.258933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601511b7-7f63-4c22-b4a1-23a9f75cd094 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:08.260404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601511b7-7f63-4c22-b4a1-23a9f75cd094 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:08.290020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 25/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:02:08 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:09.912933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57473a4-03e7-4a0f-baa4-d4d0d4eb0863 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:09.913444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57473a4-03e7-4a0f-baa4-d4d0d4eb0863 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:09.913523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57473a4-03e7-4a0f-baa4-d4d0d4eb0863 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:09.914898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 22/47] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:09.921572 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:09.922019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:09.922178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:09.939483 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:09.940657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:10.006093 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 26/48] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:10.029231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57473a4-03e7-4a0f-baa4-d4d0d4eb0863 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.131442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57473a4-03e7-4a0f-baa4-d4d0d4eb0863 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.156518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:10.165532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.166377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.166669 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.166951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.177387 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:10.185568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:10.186415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:10.187337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 23/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:10.192677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.220074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:10.295895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff0e02-43aa-4a8e-b2da-c9056f1e752d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.329739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.330439 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.330724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.331004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.331752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:10.332058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:10.333433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:10.342086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 27/50] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:10.347434 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.450355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3c9de-1993-406d-b292-8390f793cb7c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.483975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11256789-9888-47fa-a6b8-05138ba3390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.484847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11256789-9888-47fa-a6b8-05138ba3390d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.485131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11256789-9888-47fa-a6b8-05138ba3390d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.485408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11256789-9888-47fa-a6b8-05138ba3390d None admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.486835 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11256789-9888-47fa-a6b8-05138ba3390d None admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:10.488286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11256789-9888-47fa-a6b8-05138ba3390d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:10.489918 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 24/51] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:10 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:10.495311 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.554166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb15dcc-2e34-4b35-aeeb-45a88867fd20 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.554467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb15dcc-2e34-4b35-aeeb-45a88867fd20 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.554762 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb15dcc-2e34-4b35-aeeb-45a88867fd20 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.556133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 25/52] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:10.561042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.561336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.561626 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.578560 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:10.579781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:10.586971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:10.600448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670961c3-6fd5-456b-ad16-5e6244403e01 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.630186 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:10.634068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.634887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.635176 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.635456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.636639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:10.638629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:10.640268 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 28/53] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:10.645868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.648638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 26/54] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:10.671426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.747213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09201bc-b137-40c9-ad85-4ff5d578ca4a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.770802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0906dcf-3b51-462e-b5eb-1677d2cab47a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.778937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.779589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.779877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.780156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.780985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.domain.id=default, user.id=96d05461ca4045ab8fe2fd46023e1ef5) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:10.781294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:10.782785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:10.788593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 29/55] 10.222.0.30 () {56 vars in 1322 bytes} [Tue May 24 09:02:10 2022] GET /identity/v3/role_assignments?user.id=96d05461ca4045ab8fe2fd46023e1ef5&scope.domain.id=default&role.id=08b7b51186384e71b433ea9c52d3430e => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:10.810882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d5f79-05c2-4f64-80a5-a5c1e277421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.811709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5f79-05c2-4f64-80a5-a5c1e277421d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.811995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5f79-05c2-4f64-80a5-a5c1e277421d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.812272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d5f79-05c2-4f64-80a5-a5c1e277421d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.813542 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d5f79-05c2-4f64-80a5-a5c1e277421d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:10.815065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d5f79-05c2-4f64-80a5-a5c1e277421d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:10.816758 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 27/56] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:10.822580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:10.847675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:10.931955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c8b4b-6111-4b81-9eef-4b82b256d089 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:10.968853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb93a6a-6c84-474d-bbeb-40b82b20a5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:10.969530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb93a6a-6c84-474d-bbeb-40b82b20a5f3 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:10.969817 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb93a6a-6c84-474d-bbeb-40b82b20a5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:10.970122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb93a6a-6c84-474d-bbeb-40b82b20a5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:10.970848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb93a6a-6c84-474d-bbeb-40b82b20a5f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:10.972309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb93a6a-6c84-474d-bbeb-40b82b20a5f3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:10.999697 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 30/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue May 24 09:02:10 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:13.178605 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5dcb-6f20-4afd-95b8-c5fc97a07667 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:13.179100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5dcb-6f20-4afd-95b8-c5fc97a07667 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:13.179207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de5dcb-6f20-4afd-95b8-c5fc97a07667 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:13.180528 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 28/58] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:13.186150 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:13.186527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:13.186720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:13.206140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:13.207339 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:13.271690 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 31/59] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:13.295509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de5dcb-6f20-4afd-95b8-c5fc97a07667 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:13.349599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:13.397512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de5dcb-6f20-4afd-95b8-c5fc97a07667 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:13.430108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39950497-c927-4612-aafe-d99d0e61597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:13.430837 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39950497-c927-4612-aafe-d99d0e61597e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:13.431124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39950497-c927-4612-aafe-d99d0e61597e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:13.431404 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39950497-c927-4612-aafe-d99d0e61597e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:13.432584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39950497-c927-4612-aafe-d99d0e61597e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:13.434756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39950497-c927-4612-aafe-d99d0e61597e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:13.436302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 29/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:13.441786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:13.444041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:13.539918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff68ecd-9983-466b-b7d0-3ade54e6e52b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:13.572979 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b9dcc-abf2-4b73-a0bb-3862b6ef5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:13.573643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9dcc-abf2-4b73-a0bb-3862b6ef5ebf None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:13.573952 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9dcc-abf2-4b73-a0bb-3862b6ef5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:13.574759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9dcc-abf2-4b73-a0bb-3862b6ef5ebf None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:13.575483 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9dcc-abf2-4b73-a0bb-3862b6ef5ebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:13.576929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9dcc-abf2-4b73-a0bb-3862b6ef5ebf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:13.601308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 32/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:13 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:16.837299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdee06-01ad-4148-b724-dcf9af3c5c96 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:16.837804 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdee06-01ad-4148-b724-dcf9af3c5c96 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:16.837877 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdee06-01ad-4148-b724-dcf9af3c5c96 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:16.839424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 30/62] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:16.847816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5653fbc-ad2a-453b-a6b4-1022fb865db1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:16.848279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5653fbc-ad2a-453b-a6b4-1022fb865db1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:16.848454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5653fbc-ad2a-453b-a6b4-1022fb865db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:16.872469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e5653fbc-ad2a-453b-a6b4-1022fb865db1 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:16.873627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e5653fbc-ad2a-453b-a6b4-1022fb865db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:16.947932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:16.972597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:17.019525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdee06-01ad-4148-b724-dcf9af3c5c96 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.072415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f1f22-d178-4552-b3e9-6d0827e973e3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.072702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f1f22-d178-4552-b3e9-6d0827e973e3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.072907 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f1f22-d178-4552-b3e9-6d0827e973e3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.074409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 34/64] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:17.083679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.083969 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.084256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.114453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:17.115681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:17.212015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 35/65] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:17.218717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdee06-01ad-4148-b724-dcf9af3c5c96 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.240054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.251695 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:17.270771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38112cd2-87be-43e2-91e4-93a8c27735ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.272182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38112cd2-87be-43e2-91e4-93a8c27735ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.272678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38112cd2-87be-43e2-91e4-93a8c27735ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.273216 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38112cd2-87be-43e2-91e4-93a8c27735ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.286484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38112cd2-87be-43e2-91e4-93a8c27735ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-38112cd2-87be-43e2-91e4-93a8c27735ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:17.296285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:17.297193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:17.298274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:17.300940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 31/66] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:17.302592 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af081ab-4e57-46fb-9ceb-3e2f73d7b652 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.303098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af081ab-4e57-46fb-9ceb-3e2f73d7b652 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.303580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af081ab-4e57-46fb-9ceb-3e2f73d7b652 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.305736 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 32/67] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:17.306665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af081ab-4e57-46fb-9ceb-3e2f73d7b652 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.360583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d011c-b436-4b52-b3f3-cb329f91d0a0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.379498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:17.399740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc321f0-b1a7-4e13-a919-a7243fd76c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.400877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc321f0-b1a7-4e13-a919-a7243fd76c56 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.401365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc321f0-b1a7-4e13-a919-a7243fd76c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.401891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc321f0-b1a7-4e13-a919-a7243fd76c56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.416149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc321f0-b1a7-4e13-a919-a7243fd76c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:17.419518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af081ab-4e57-46fb-9ceb-3e2f73d7b652 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5dc321f0-b1a7-4e13-a919-a7243fd76c56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:17.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:17.426528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:17.427286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:17.429657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 36/68] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:17.431133 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfeb4-f62e-44e9-b3fd-8f1e2e8e6a5f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.431627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfeb4-f62e-44e9-b3fd-8f1e2e8e6a5f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.432110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfeb4-f62e-44e9-b3fd-8f1e2e8e6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.457669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c69cfeb4-f62e-44e9-b3fd-8f1e2e8e6a5f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:17.460269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c69cfeb4-f62e-44e9-b3fd-8f1e2e8e6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:17.469276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.470262 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.470697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.471781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.472774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:17.473240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:17.475626 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:17.491481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 33/69] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:17.497134 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.537783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 37/70] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:17.539459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d461-d846-431b-b726-07a2cdada9b0 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.539755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d461-d846-431b-b726-07a2cdada9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.540039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d461-d846-431b-b726-07a2cdada9b0 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.545990 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 38/71] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:17.546698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d461-d846-431b-b726-07a2cdada9b0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.552667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:17.616433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c28fd-27e8-4dd6-a219-ac5261072679 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.651194 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.651864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.652149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.653032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.653781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:17.654417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:17.655543 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03ccef-bc35-47b8-82b5-66cbfb118935 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:17.660788 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d461-d846-431b-b726-07a2cdada9b0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.663965 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 34/72] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:17.665245 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a494-9380-4a7d-b73b-0682a6b6b7fd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.665540 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a494-9380-4a7d-b73b-0682a6b6b7fd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.665828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4a494-9380-4a7d-b73b-0682a6b6b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.673179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:17.681976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a3a4a494-9380-4a7d-b73b-0682a6b6b7fd None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:17.683166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a3a4a494-9380-4a7d-b73b-0682a6b6b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:17.698823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.700269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.700560 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.700836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.714250 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:17.715876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:17.717551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 39/73] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:17.722056 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.751637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 35/74] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:17.753036 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4b4f5-0f69-4141-b896-65efcacb2bb9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.753336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4b4f5-0f69-4141-b896-65efcacb2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.753622 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4b4f5-0f69-4141-b896-65efcacb2bb9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.755080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 36/75] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:17.759234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4b4f5-0f69-4141-b896-65efcacb2bb9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.804110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:17.822956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b07bd-8266-4ba8-a8bf-00153d67eeb8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.858745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.859556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.859833 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.860118 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.870149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:17.872836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4b4f5-0f69-4141-b896-65efcacb2bb9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:17.878764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:17.879623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:17.880592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 40/76] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:17.881437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:17.907954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:17.909760 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc236fb3-4095-4e3d-9864-155c7e33dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:17.911011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236fb3-4095-4e3d-9864-155c7e33dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.911299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236fb3-4095-4e3d-9864-155c7e33dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.911626 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236fb3-4095-4e3d-9864-155c7e33dc38 None admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.912842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc236fb3-4095-4e3d-9864-155c7e33dc38 None admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:17.914347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc236fb3-4095-4e3d-9864-155c7e33dc38 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:17.915973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 37/77] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:17.917179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:17.917472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:17.917752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:17.934685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:17.935883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:17.984528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ea33b-c1c5-45f4-aac2-2da28ff2fb45 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.001526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 38/78] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:18.002220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.018207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.018858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.019147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.019425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.034517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.086925 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.088418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.103735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d582f-efef-4fd1-a49e-9a18d68873ac None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.115047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.138807 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.139511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.139817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.140076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.150099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:18.157711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:18.158616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:18.159362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 39/79] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:18.159979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.188232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 41/80] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:18.189097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.251827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.261117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921ae8-bcd7-426a-b6db-972f2e07d900 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.288764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34081fc-96e1-4350-bb03-d3ade5972e39 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.296011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.296700 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.296986 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.297270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.298295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:18.298609 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.300005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.307802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 40/81] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.310292 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.316149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.326054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.326736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.326996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.327520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.394021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.395448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.409312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434101b-6ee3-46bb-9f4d-537ce265ab5b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.443481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.444274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.444560 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.444846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.446063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.447516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.449151 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 41/82] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.449935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.474556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.498178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 42/83] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:18.499309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.524966 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.555377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fce3a-0124-4cca-8382-f96d44564172 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.588270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.588931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.589216 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.589490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.590916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:18.591224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.592600 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.596917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2901-6257-415f-9903-8c19acfd3fb6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.600476 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 42/84] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.601259 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.631365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.632226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.632513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.632793 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.634016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.635473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.637383 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 43/85] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.638150 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.686087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.701936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df303-4ebc-43c3-9c83-725cae944c4c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.734471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.734842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.735714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.735999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.736313 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.737583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.739199 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.740817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 43/86] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.745524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.745648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ae842-77c6-459d-a936-574e1b89a714 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.779790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.780469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.780757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.781039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.781754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.783234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.803734 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 44/87] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:18 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:18.804569 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.858392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fe091-0a6a-4b45-a325-4a3a5e97c10e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.898908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.899929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.900217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.900500 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.901809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.904035 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.905950 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 44/88] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.911374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.921095 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf6b3a-a641-48ef-b145-0a17379af7f9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:18.935923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:18.962171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:18.962973 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:18.963257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:18.963535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:18.965105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:18.967514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:18.974629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 45/89] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:18.975225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:18.999777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:19.030202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a1666-7c35-4797-ad51-da9c2949f979 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.072554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.073590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.073879 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.075971 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.076839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=90ae04531d9d4084be238a8e8c7877d9) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:19.077160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.078830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.092305 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 45/90] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/role_assignments?user.id=90ae04531d9d4084be238a8e8c7877d9&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=e11d9924ba394c088bd2aee20d352866 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:19.093169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:19.107400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d892-714b-4dd9-8339-29ef54cf7041 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.162983 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.164821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.165380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.166174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.211832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:19.233112 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69651222-219d-4994-9a2b-baba83b3c402 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.266254 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.268594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.273493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.274577 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.275079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.275558 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.276613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=96d05461ca4045ab8fe2fd46023e1ef5) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:19.277212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.279023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.286090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 46/91] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:19 2022] GET /identity/v3/role_assignments?user.id=96d05461ca4045ab8fe2fd46023e1ef5&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:19.287359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:19.310341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:19.402915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 46/92] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:19.409159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:19.432684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b299-e331-453f-94c4-2089b40a0ed2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.500116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.502021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.503538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.504062 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.561544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:19.600117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5344c6-1c49-49d9-9e21-6d514804b0c9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.639999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.641814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.646267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:19.669776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.670644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.670934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.671213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.678840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.680610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.682486 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 47/93] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:19 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:19.688484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:19.761336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 47/94] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:19.767212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:19.830320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:19.888440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808347e-839e-43dd-9796-f45aba5dfe60 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.890277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed036189-8692-4bbf-989c-d873d13b493b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:19.929616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.931613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.932094 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.932715 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] PATH_INFO: `/v3/projects/b105c4e39aa44792be3c3784c489412e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.934693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] RBAC: Authorizing `identity:get_project(project_id=b105c4e39aa44792be3c3784c489412e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.936366 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.938370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 48/95] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:19 2022] GET /identity/v3/projects/b105c4e39aa44792be3c3784c489412e => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:19.943928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:19.978635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:19.979335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:19.979598 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:19.979883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:19.980829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] RBAC: Adding query filter params (role.id=404a4769ebb543319b7a918411953668, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=90ae04531d9d4084be238a8e8c7877d9) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:19.981146 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:19.982708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace77ab2-4b97-4193-b328-1604bc6dd0d5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:19.999866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 48/96] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:19 2022] GET /identity/v3/role_assignments?user.id=90ae04531d9d4084be238a8e8c7877d9&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=404a4769ebb543319b7a918411953668 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:20.055040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dc642-4c5e-463f-97ef-69fcbc26725d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:20.074333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:20.112795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:20.113473 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:20.113758 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:20.114072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:20.114908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=b105c4e39aa44792be3c3784c489412e, user.id=90ae04531d9d4084be238a8e8c7877d9) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:20.115224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:20.116683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d14261-0e79-4087-b728-bab8063e1fa5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:20.126631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 49/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:19 2022] GET /identity/v3/role_assignments?user.id=90ae04531d9d4084be238a8e8c7877d9&scope.project.id=b105c4e39aa44792be3c3784c489412e&role.id=e11d9924ba394c088bd2aee20d352866 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:22.153103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca9bff-610d-4e19-8596-cde8652dbb0a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.153622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca9bff-610d-4e19-8596-cde8652dbb0a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.153710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca9bff-610d-4e19-8596-cde8652dbb0a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.155111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 49/98] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:22.160525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.160941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.161129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.182881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:22.184614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:22.270453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 50/99] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:22.304784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032907-1e7d-4277-9163-96603b194f95 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.305099 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032907-1e7d-4277-9163-96603b194f95 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.305365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032907-1e7d-4277-9163-96603b194f95 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.306847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 50/100] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:22.310146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:22.312854 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.313145 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.313423 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.341661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:22.342950 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:22.464201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:22.522084 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 51/101] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:22.542504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45787573-ada9-4f9c-ad23-06d4ddbe4af9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:22.566779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:22.567733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:22.638676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad9315-f4ae-4617-9bd2-8cda7337dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:22.639486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad9315-f4ae-4617-9bd2-8cda7337dc87 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.639772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad9315-f4ae-4617-9bd2-8cda7337dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.640052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad9315-f4ae-4617-9bd2-8cda7337dc87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.641261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad9315-f4ae-4617-9bd2-8cda7337dc87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:22.642757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad9315-f4ae-4617-9bd2-8cda7337dc87 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:22.644383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 51/102] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:22.645554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b5ad-d212-4a06-8043-0c7cb8618d0e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.645841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b5ad-d212-4a06-8043-0c7cb8618d0e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.646144 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b5ad-d212-4a06-8043-0c7cb8618d0e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.647509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 52/103] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:22.648510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe41295-b671-4c39-99f4-e32b916d29fa None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.648798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe41295-b671-4c39-99f4-e32b916d29fa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.649075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe41295-b671-4c39-99f4-e32b916d29fa None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.650581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 53/104] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:22.655681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.655978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.656265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.675913 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:22.678175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:22.699759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2db17-f699-465b-9b46-4faad8cb1719 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:22.738771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610300-fed7-4843-9041-4399af5107e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:22.739495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610300-fed7-4843-9041-4399af5107e8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.739784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610300-fed7-4843-9041-4399af5107e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.740062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610300-fed7-4843-9041-4399af5107e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.751685 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7610300-fed7-4843-9041-4399af5107e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:22.755633 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 54/105] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:22.756535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f7610300-fed7-4843-9041-4399af5107e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:22.768152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:22.769051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:22.769816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 52/106] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:22.770988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.771149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.771287 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.809954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:22.809954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:22.843319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:22.867524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e77320-7de3-4fb3-8700-5333b9f87c48 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:22.879337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:22.882107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 53/107] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:22.883157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:22.908833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:22.909815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:22.910306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:22.910763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:22.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:22.913302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:22.940918 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 55/108] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:02:22 2022] POST /identity/v3/projects => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:22.947263 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.002582 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c66e66-934b-4706-8549-e1cf1fbdb049 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.052516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.053532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.054004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.054447 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.055482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:23.055970 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.057792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa92e-963a-449b-b114-b745ac49536b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.068062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 54/109] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.069791 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08e7aa-11f3-4433-8d0a-f5d67d36cd7d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.070241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08e7aa-11f3-4433-8d0a-f5d67d36cd7d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.070745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08e7aa-11f3-4433-8d0a-f5d67d36cd7d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.072353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 55/110] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:23.073392 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08e7aa-11f3-4433-8d0a-f5d67d36cd7d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.111176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f6bd7-5939-4f10-8750-aa3b7df2340a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.114947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.163566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.164390 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.164680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.164959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.180781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:23.191167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:23.192053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:23.192794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 56/111] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:23.193412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.211076 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08e7aa-11f3-4433-8d0a-f5d67d36cd7d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.222082 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.255430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef449a-711a-4356-977f-692411d51edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.256360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef449a-711a-4356-977f-692411d51edb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.256752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef449a-711a-4356-977f-692411d51edb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.257160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef449a-711a-4356-977f-692411d51edb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.268595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef449a-711a-4356-977f-692411d51edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0fef449a-711a-4356-977f-692411d51edb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:23.278823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:23.279851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:23.280773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:23.282891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 56/112] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:23.283997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.284383 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.289326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.307524 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:23.309251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:23.331559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f421e8-f0e7-479d-9467-311e8ff425ca None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.371536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.372955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.373124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.373471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.374867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.376544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.378529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 57/113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.379431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.418328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 57/114] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:23.418328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.457804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.516752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.532515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165b995-d967-47c2-ba8e-c35a891114b1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.547400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f313a-ba89-40ab-b909-89867616fdb9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.568845 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.569777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.570263 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.570706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.571920 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:23.572368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.574433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.583737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 58/115] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.584641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.591833 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.592810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.593311 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.593812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.594811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:23.595848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.598027 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.610439 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 58/116] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.611534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.696071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6e690-be44-40ee-bd81-a17a4aa52df1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.702170 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.724734 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd53aa-8544-4f5b-8793-a40fb8cacf92 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.732575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.733456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.733745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.734069 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.735275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.736745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.742893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 59/117] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.742893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.758739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.768482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578db16e-0296-4578-92c6-5aefb4285f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.769344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db16e-0296-4578-92c6-5aefb4285f89 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.769702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db16e-0296-4578-92c6-5aefb4285f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.770075 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db16e-0296-4578-92c6-5aefb4285f89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.782668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578db16e-0296-4578-92c6-5aefb4285f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-578db16e-0296-4578-92c6-5aefb4285f89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:23.796936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:23.798253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:23.799262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 59/118] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:23.804466 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079356-ef75-4293-949f-fd90b8cd7bd3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.804761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079356-ef75-4293-949f-fd90b8cd7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.805047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079356-ef75-4293-949f-fd90b8cd7bd3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.806522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 60/119] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:23.807069 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079356-ef75-4293-949f-fd90b8cd7bd3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.851461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd348039-28b1-46e0-b9a9-b508ebfc2782 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.888215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.889087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.889377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.889656 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.890889 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.892343 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.894179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 60/120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.894970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.923122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079356-ef75-4293-949f-fd90b8cd7bd3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:23.959935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:23.960821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:23.961114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:23.961398 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] PATH_INFO: `/v3/users/fa709de53ddb4803b650a98a81014c82` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:23.974816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] RBAC: Authorizing `identity:get_user(user_id=fa709de53ddb4803b650a98a81014c82)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:23.976306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:23.977996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/users/fa709de53ddb4803b650a98a81014c82 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:23.978774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:23.982058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:23.989999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.006770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67611-81ed-4704-9cb4-9817c83c8834 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.045261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd84e-a74c-49ed-a3fd-359824cf2267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.046106 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd84e-a74c-49ed-a3fd-359824cf2267 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.046397 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd84e-a74c-49ed-a3fd-359824cf2267 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.046679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd84e-a74c-49ed-a3fd-359824cf2267 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/90ae04531d9d4084be238a8e8c7877d9/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.048932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dd84e-a74c-49ed-a3fd-359824cf2267 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user_id=90ae04531d9d4084be238a8e8c7877d9, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.050565 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dd84e-a74c-49ed-a3fd-359824cf2267 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.067588 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 61/122] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:23 2022] PUT /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/90ae04531d9d4084be238a8e8c7877d9/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:24.072159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.072757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.073319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.090747 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2437d-d79e-4f25-a69a-404da269b7c2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.099122 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:24.100747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:24.138425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.139251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.139539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.139815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.140778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:24.141097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.142923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.153638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 62/123] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:24.154914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.200864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 62/124] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:24.201963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.241650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.287809 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc528d2-370b-493f-9a9e-70a3f780846a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.317165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.332610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.333479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.333761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.334070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.336093 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.336703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.338620 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 63/125] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:24.339294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.351725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cfd72-1969-48b3-9a63-622c88fb8e6c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.395392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.396705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.397099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.397780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.453343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dadba-ebfb-4b8b-bd0c-4616dd4f0a1f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.489623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.492867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.494461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.503912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.505650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.506169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.507045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.508809 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.511312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.513724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 64/126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:24.514683 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.599037 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.633158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 63/127] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:24.634267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.640274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca039b2-ccde-4f56-9028-fdc03d63909b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.684087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.685142 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.685576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.686591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.701848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:24.712792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:24.713816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:24.714919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:24.717874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 65/128] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:24.719251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.763644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f4412-594a-4788-a9be-d61a8b85b9d4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.782316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.809628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.811181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.811679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.812178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/96d05461ca4045ab8fe2fd46023e1ef5/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.815142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user_id=96d05461ca4045ab8fe2fd46023e1ef5, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.817331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.835135 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 64/129] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:24 2022] PUT /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/96d05461ca4045ab8fe2fd46023e1ef5/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:24.836156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858773bc-ccad-4f3d-97fd-b4d5ccf97737 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:24.836520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:24.887369 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:24.889805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:24.891029 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:24.891839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:24.893100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:24.894882 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:24.896624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:24.908207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 66/130] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:24.909367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.045232 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc54a-d1db-4984-bfc0-a11f88d13de8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.090097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71304d47-ab0c-4419-9df9-d4ca2de8a503 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.111844 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.112887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.113242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.113587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.114904 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.116532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.118462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 65/131] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:25.119281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.127396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:25.136132 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.137133 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.137657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.138885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.139919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:25.140439 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.142196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.153052 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 67/132] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:25.154456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.244212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946954a-fc9b-437e-8310-3f69e3a44b93 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.247330 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:25.264097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7160f-d204-44dd-a7b0-11845e3d74e8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.300592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.301617 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.302156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.302732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.303775 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] RBAC: Adding query filter params (role.id=20c7e935f42040f295131da1f4c7a63f, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=fa709de53ddb4803b650a98a81014c82) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:25.304320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.306068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.312987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 68/133] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:25 2022] GET /identity/v3/role_assignments?user.id=fa709de53ddb4803b650a98a81014c82&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=20c7e935f42040f295131da1f4c7a63f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:25.313877 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48880-9d38-4772-abf4-7d7d86cb45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.314311 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.314868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48880-9d38-4772-abf4-7d7d86cb45f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.315160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48880-9d38-4772-abf4-7d7d86cb45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.315444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48880-9d38-4772-abf4-7d7d86cb45f5 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/90ae04531d9d4084be238a8e8c7877d9/roles/404a4769ebb543319b7a918411953668` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.330819 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde48880-9d38-4772-abf4-7d7d86cb45f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user_id=90ae04531d9d4084be238a8e8c7877d9, role_id=404a4769ebb543319b7a918411953668)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.332313 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde48880-9d38-4772-abf4-7d7d86cb45f5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.373566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 66/134] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:25 2022] PUT /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/90ae04531d9d4084be238a8e8c7877d9/roles/404a4769ebb543319b7a918411953668 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:25.381326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:25.410980 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b31d-3d50-4e66-ba92-60b0b56e575a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.411308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b31d-3d50-4e66-ba92-60b0b56e575a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.411559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0b31d-3d50-4e66-ba92-60b0b56e575a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.413132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 67/135] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:25.421104 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.421536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.421933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.438163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b1827-dbbe-4b1a-9be3-af7d41fe1076 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.442066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:25.442702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:25.477746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.478960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.479416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.479850 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.482421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.484194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.486293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 69/136] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:25 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:25.495043 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.533963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 68/137] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:25.567102 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.693817 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c008-271c-4045-860f-895795c6fc46 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.721450 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:25.738202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.739079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.739365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.739642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] PATH_INFO: `/v3/projects/b105c4e39aa44792be3c3784c489412e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.740954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] RBAC: Authorizing `identity:get_project(project_id=b105c4e39aa44792be3c3784c489412e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.746840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.746840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 70/138] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:25 2022] GET /identity/v3/projects/b105c4e39aa44792be3c3784c489412e => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:25.750912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.789279 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:25.807907 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6948ef-7750-471e-b5ab-759ca4ed3a8c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.868632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d88946-e066-4e5e-aa9c-5425b949c20e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:25.877734 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.878693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.878986 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.879268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.880562 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.882046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.883908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 69/139] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:25.890211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:25.912462 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aefae-a3fb-4d10-9808-7ff3ad64aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:25.913374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aefae-a3fb-4d10-9808-7ff3ad64aa3c None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:25.914875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aefae-a3fb-4d10-9808-7ff3ad64aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:25.915174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aefae-a3fb-4d10-9808-7ff3ad64aa3c None admin] PATH_INFO: `/v3/projects/b105c4e39aa44792be3c3784c489412e/users/90ae04531d9d4084be238a8e8c7877d9/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:25.919372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aefae-a3fb-4d10-9808-7ff3ad64aa3c None admin] RBAC: Authorizing `identity:create_grant(project_id=b105c4e39aa44792be3c3784c489412e, user_id=90ae04531d9d4084be238a8e8c7877d9, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:25.922017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aefae-a3fb-4d10-9808-7ff3ad64aa3c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:25.953739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 71/140] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:25 2022] PUT /identity/v3/projects/b105c4e39aa44792be3c3784c489412e/users/90ae04531d9d4084be238a8e8c7877d9/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:26.056586 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de88cbb-75f3-4faf-95d1-c0e978472579 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:26.110657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5bcc3-c609-4d70-b0ad-8a6d2308df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:26.111768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5bcc3-c609-4d70-b0ad-8a6d2308df11 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:26.112266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5bcc3-c609-4d70-b0ad-8a6d2308df11 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:26.112784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5bcc3-c609-4d70-b0ad-8a6d2308df11 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:26.113746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5bcc3-c609-4d70-b0ad-8a6d2308df11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:26.115584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5bcc3-c609-4d70-b0ad-8a6d2308df11 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:26.161294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 70/141] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:25 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:26.934729 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd202a-4431-4f66-aa58-832dd7fcbd8b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:26.935242 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd202a-4431-4f66-aa58-832dd7fcbd8b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:26.935315 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd202a-4431-4f66-aa58-832dd7fcbd8b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:26.937073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 72/142] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:26.943105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:26.943639 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:26.943713 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:26.965872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:26.967115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:26.987046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:27.048842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 71/143] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:27.084415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd202a-4431-4f66-aa58-832dd7fcbd8b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:27.148242 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:27.219322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd202a-4431-4f66-aa58-832dd7fcbd8b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:27.266522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:27.267323 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:27.267608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:27.267882 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:27.282801 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:27.290757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:27.291589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:27.292322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 73/144] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:27.299783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:27.436747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2af92d-2e73-4abf-a417-915232c57d92 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:27.479553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:27.480364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:27.480653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:27.480977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:27.481689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:27.482027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:27.483433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:27.498155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 72/145] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:27.503537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:27.634836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1062a-a2b7-407d-93c8-e5e84c60ef26 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:27.648115 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:27.674021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:27.674910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:27.675202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:27.675470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:27.676705 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:27.678222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:27.680871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 74/146] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:27 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:27.686188 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:27.713576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:27.828176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af203091-99fb-48bf-a461-3a813b9c0960 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:27.875973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:27.876633 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:27.876919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:27.877198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:27.960072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:27.961579 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:27.977593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:28.087402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 73/147] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:28.093756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:28.226160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4bf3-56ad-48d2-92bb-e7bd77a9a3cc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:28.269735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcc3ef-3cd5-4d46-8246-ebf47b3f2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:28.270639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcc3ef-3cd5-4d46-8246-ebf47b3f2f87 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:28.270919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcc3ef-3cd5-4d46-8246-ebf47b3f2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:28.271192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcc3ef-3cd5-4d46-8246-ebf47b3f2f87 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:28.278679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcc3ef-3cd5-4d46-8246-ebf47b3f2f87 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:28.280160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcc3ef-3cd5-4d46-8246-ebf47b3f2f87 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:28.282156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 75/148] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:28 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:28.287791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:28.429490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197cf7f-d6bf-4a37-ab8b-bacd3e2c2dd4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:28.442038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:28.468468 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:28.469502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:28.470017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:28.470550 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:28.471634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=90ae04531d9d4084be238a8e8c7877d9) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:28.472150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:28.473871 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844292-e407-47ef-8982-7122c5938b35 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:28.481633 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 74/149] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:28 2022] GET /identity/v3/role_assignments?user.id=90ae04531d9d4084be238a8e8c7877d9&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=e11d9924ba394c088bd2aee20d352866 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:29.141509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d25e-9e0d-4278-9323-53e2350c0915 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.142026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d25e-9e0d-4278-9323-53e2350c0915 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.142026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d25e-9e0d-4278-9323-53e2350c0915 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.143435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 76/150] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:29.148727 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300a087-a596-48c0-90c6-8594b9832bd6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.149576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300a087-a596-48c0-90c6-8594b9832bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.150080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300a087-a596-48c0-90c6-8594b9832bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.160612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69135-178e-47f4-bdde-f55bc7b7ec19 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.160612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69135-178e-47f4-bdde-f55bc7b7ec19 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.160612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69135-178e-47f4-bdde-f55bc7b7ec19 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.161201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 77/151] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:29.167766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.168336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.168915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.182932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b300a087-a596-48c0-90c6-8594b9832bd6 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:29.184977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b300a087-a596-48c0-90c6-8594b9832bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:29.199053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:29.202540 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:29.302976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:29.334444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 75/152] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:29.336129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade9f9-2739-40ca-bf37-d9cdbf3fc944 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.336583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade9f9-2739-40ca-bf37-d9cdbf3fc944 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.336999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ade9f9-2739-40ca-bf37-d9cdbf3fc944 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.343100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 76/153] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:29.346975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 78/154] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:29.355467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.355930 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.356349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.377654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:29.379082 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:29.382879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:29.487555 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 77/155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:29.488822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:29.535400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:29.562315 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa5160-4901-4d27-90fe-4ab5a41dbdf3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:29.610223 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26029912-ccc1-4fa4-abe5-55c8728c9330 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:29.638154 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:29.639049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.639331 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.639604 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.648022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:29.648998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.649420 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.649833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.661591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:29.661825 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:29.669681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:29.670737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:29.671635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:29.672636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:29.673836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:29.674818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:29.677108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 78/156] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:29.678072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:29.679200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 79/157] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:29.682880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:29.746449 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:29.790486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:29.800270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b05314-2b3f-4f24-8b24-f3ec6f3c21d9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:29.838902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:29.840809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.841241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.841656 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.853994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:29.863769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:29.864812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:29.865746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:29.868365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 79/158] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:29.869725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:29.891969 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe08bf-e013-4a22-8acf-de3482eb6ae2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:29.986403 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92cb9-06f9-43ee-a89d-31d8a347842f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:29.994672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:29.995591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:29.995805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:29.995958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:29.996801 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:29.997053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:29.998806 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.017269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 80/159] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:30.018159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.028770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.029696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.030219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.030638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.032436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:30.032895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.034515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.045453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 80/160] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:30.046993 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.068997 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:30.170868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156263b-6ceb-4fe3-a0c3-e8da033a7a51 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.211938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.213213 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.213667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.214111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] PATH_INFO: `/v3/users/fa709de53ddb4803b650a98a81014c82` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.215883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] RBAC: Authorizing `identity:get_user(user_id=fa709de53ddb4803b650a98a81014c82)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.217499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.219891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 81/161] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/users/fa709de53ddb4803b650a98a81014c82 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:30.220836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.295680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:30.308094 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe370f-1cf0-4eb3-800e-90ef21922169 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.324465 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:30.343952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb9d8-18a8-48e9-8d2e-bae224fa9f9f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.382827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e91380-43ad-40a4-a834-e67c61fae964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.384197 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91380-43ad-40a4-a834-e67c61fae964 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.384671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91380-43ad-40a4-a834-e67c61fae964 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.385484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e91380-43ad-40a4-a834-e67c61fae964 None admin] PATH_INFO: `/v3/users/96d05461ca4045ab8fe2fd46023e1ef5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.387271 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e91380-43ad-40a4-a834-e67c61fae964 None admin] RBAC: Authorizing `identity:get_user(user_id=96d05461ca4045ab8fe2fd46023e1ef5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.389119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e91380-43ad-40a4-a834-e67c61fae964 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.391312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 82/162] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/users/96d05461ca4045ab8fe2fd46023e1ef5 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:30.392776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eddee-c770-4e32-9541-8837aa689b6e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.393243 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eddee-c770-4e32-9541-8837aa689b6e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.394000 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eddee-c770-4e32-9541-8837aa689b6e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.395530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 83/163] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:30.396417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eddee-c770-4e32-9541-8837aa689b6e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.407186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.407955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.408307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.408667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.409491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:30.409866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.411368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.432143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 81/164] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:30.432996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.522057 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8eddee-c770-4e32-9541-8837aa689b6e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.564199 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955fc17-d198-4992-928b-6c2b25520446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.565354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955fc17-d198-4992-928b-6c2b25520446 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.565848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955fc17-d198-4992-928b-6c2b25520446 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.566325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955fc17-d198-4992-928b-6c2b25520446 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.568492 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955fc17-d198-4992-928b-6c2b25520446 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.570167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955fc17-d198-4992-928b-6c2b25520446 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.572168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 84/165] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:30.573556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.574446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.574908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.594334 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:30.596352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:30.613574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:30.676043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 85/166] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:30.677169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.714471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3316e7-ba72-46e9-b917-c3bfbb480987 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.754341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102221-8f0d-4536-afa9-6a01219640b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.755680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102221-8f0d-4536-afa9-6a01219640b8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.755680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102221-8f0d-4536-afa9-6a01219640b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.755861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102221-8f0d-4536-afa9-6a01219640b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.786362 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:30.787595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db419f8-6209-44ec-b587-add6da6ce6d0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.825752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.827028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.827511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.827984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.829411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.831162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.833077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 86/167] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:30.834037 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.840460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102221-8f0d-4536-afa9-6a01219640b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.841959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102221-8f0d-4536-afa9-6a01219640b8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:30.855395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:30.941456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b8c37-15f6-4335-91eb-d6b33b7f0539 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:30.952452 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 82/168] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:30.953847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14d44-c66d-437d-b6ea-be8bccf6fbd8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.954176 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14d44-c66d-437d-b6ea-be8bccf6fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.954453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14d44-c66d-437d-b6ea-be8bccf6fbd8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.958070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 83/169] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:30.958070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14d44-c66d-437d-b6ea-be8bccf6fbd8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:30.986300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:30.987201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:30.987485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:30.987758 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/fa709de53ddb4803b650a98a81014c82/roles/20c7e935f42040f295131da1f4c7a63f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:30.989771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user_id=fa709de53ddb4803b650a98a81014c82, role_id=20c7e935f42040f295131da1f4c7a63f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:30.991306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:31.004469 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 87/170] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:30 2022] PUT /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/users/fa709de53ddb4803b650a98a81014c82/roles/20c7e935f42040f295131da1f4c7a63f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:31.005272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.035166 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.084890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14d44-c66d-437d-b6ea-be8bccf6fbd8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.130129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.131292 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddaf12-bad0-4bac-88ca-42d7939a55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.132426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddaf12-bad0-4bac-88ca-42d7939a55cc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.132885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddaf12-bad0-4bac-88ca-42d7939a55cc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.133626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddaf12-bad0-4bac-88ca-42d7939a55cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.154727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddaf12-bad0-4bac-88ca-42d7939a55cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:31.160027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2c26-13e5-41fd-bdde-14ba80d07292 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-02ddaf12-bad0-4bac-88ca-42d7939a55cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:31.166565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:31.167974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:31.168962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:31.171423 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 84/171] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:31.173372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4113b-d2b1-40b0-866d-e3becf74e79b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.173498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4113b-d2b1-40b0-866d-e3becf74e79b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.173768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4113b-d2b1-40b0-866d-e3becf74e79b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.179751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 85/172] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:31.180863 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4113b-d2b1-40b0-866d-e3becf74e79b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.210089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.212093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.212535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.213255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.296431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:31.298504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:31.315271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4113b-d2b1-40b0-866d-e3becf74e79b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.341942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.362390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74933174-711b-4e18-8b13-e92d58c09957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.363796 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933174-711b-4e18-8b13-e92d58c09957 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.364408 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933174-711b-4e18-8b13-e92d58c09957 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.364858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74933174-711b-4e18-8b13-e92d58c09957 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.366769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74933174-711b-4e18-8b13-e92d58c09957 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:31.369173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74933174-711b-4e18-8b13-e92d58c09957 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:31.372193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 86/173] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:31.373878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d10c-cce3-4eb8-8acb-c17524e129c8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.374363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d10c-cce3-4eb8-8acb-c17524e129c8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.374813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d10c-cce3-4eb8-8acb-c17524e129c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.390015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.395210 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4ba1d10c-cce3-4eb8-8acb-c17524e129c8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:31.396375 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4ba1d10c-cce3-4eb8-8acb-c17524e129c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:31.414959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 88/174] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:31.415606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.473472 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 87/175] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:31.474906 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7701d-c3b2-4d40-b17d-8babff0a783f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.475271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7701d-c3b2-4d40-b17d-8babff0a783f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.475625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7701d-c3b2-4d40-b17d-8babff0a783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.492518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-03c7701d-c3b2-4d40-b17d-8babff0a783f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:31.493810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-03c7701d-c3b2-4d40-b17d-8babff0a783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:31.538411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6457a-30ac-44f3-ae97-66f8368f7e1d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.571762 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 88/176] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:31.573319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34a20b-f5db-4fbc-b9f6-4b35bb2adbcc None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.574225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34a20b-f5db-4fbc-b9f6-4b35bb2adbcc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.574580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34a20b-f5db-4fbc-b9f6-4b35bb2adbcc None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.576007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 89/177] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:31.576789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34a20b-f5db-4fbc-b9f6-4b35bb2adbcc None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.582769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.583556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.583916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.584283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.585124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:31.585507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:31.587019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:31.599769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 89/178] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:31.600875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.636004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.647908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.691717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34a20b-f5db-4fbc-b9f6-4b35bb2adbcc None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.715459 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e215303-46da-4bb5-a6ba-524655fd55ce None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.726051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.726812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.727097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.727376 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.728276 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=96d05461ca4045ab8fe2fd46023e1ef5) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:31.728593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:31.730257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:31.745935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 90/179] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/role_assignments?user.id=96d05461ca4045ab8fe2fd46023e1ef5&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:31.745935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.757186 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda977-2d3b-4342-b733-b36b7e99b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.758172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda977-2d3b-4342-b733-b36b7e99b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.758505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda977-2d3b-4342-b733-b36b7e99b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.758792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda977-2d3b-4342-b733-b36b7e99b5c6 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.760086 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda977-2d3b-4342-b733-b36b7e99b5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:31.762196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda977-2d3b-4342-b733-b36b7e99b5c6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:31.764276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 90/180] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:31.765339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a355-b035-435b-a279-461b9ca336bc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.765639 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a355-b035-435b-a279-461b9ca336bc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.765938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115a355-b035-435b-a279-461b9ca336bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.783960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8115a355-b035-435b-a279-461b9ca336bc None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:31.785286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8115a355-b035-435b-a279-461b9ca336bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:31.874765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 91/181] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:31.875792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115a355-b035-435b-a279-461b9ca336bc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.888295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025944db-f798-4ccc-8ea3-b6c4473fd2b4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:31.914343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.922082 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:31.928784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:31.930487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:31.931093 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:31.931938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:31.946073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:31.956774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:31.957662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:31.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:31.960824 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 91/182] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:31.961954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:31.999975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115a355-b035-435b-a279-461b9ca336bc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.047934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.048763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.049048 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.049330 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.062442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:32.070667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:32.071532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:32.072484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 92/183] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:32.073268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.080829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a266dac-183c-4c3c-9382-fe06d13eedb3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.118158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.119034 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.119305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.119577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] PATH_INFO: `/v3/users/90ae04531d9d4084be238a8e8c7877d9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.121108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] RBAC: Authorizing `identity:get_user(user_id=90ae04531d9d4084be238a8e8c7877d9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.122608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.124413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 92/184] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:31 2022] GET /identity/v3/users/90ae04531d9d4084be238a8e8c7877d9 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.125046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.171948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.179208 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.183430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711130-f704-4604-aa19-c05aeb174158 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.219800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.220440 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.220996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.220996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.221805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] RBAC: Adding query filter params (role.id=404a4769ebb543319b7a918411953668, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=90ae04531d9d4084be238a8e8c7877d9) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:32.222146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.223601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.229742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 93/185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/role_assignments?user.id=90ae04531d9d4084be238a8e8c7877d9&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=404a4769ebb543319b7a918411953668 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.238242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.243853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5fe2f-4e28-402a-80c7-25a8fea850f3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.288907 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.289830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.290203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.290545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.291883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.293924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.296107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 93/186] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.301934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.361724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c212b-ac55-479d-9968-b29ae139f18f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.399266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.399779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.400072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.400354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.401718 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:32.401718 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.402989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.412808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 94/187] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.413823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.438003 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8602-9b19-4873-818d-b356150669c1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.443790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.452355 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.487122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.487798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.488084 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.488363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.489124 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:32.489436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.490922 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.504246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 94/188] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.505127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.551715 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fba210-7602-42e4-b105-a73bc7098b47 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.587065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.587721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.588010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.588291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.613137 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3452-2d04-492d-8827-2725f79b9d09 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.647403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83200f8-116e-4949-889d-629d577c094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.648079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83200f8-116e-4949-889d-629d577c094c None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.648366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83200f8-116e-4949-889d-629d577c094c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.648645 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83200f8-116e-4949-889d-629d577c094c None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.649409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83200f8-116e-4949-889d-629d577c094c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.650847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83200f8-116e-4949-889d-629d577c094c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.659608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.661571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.681933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 95/189] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:32 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:32.681933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83200f8-116e-4949-889d-629d577c094c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.691651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.727563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.795526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 95/190] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:32.795526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.840728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83200f8-116e-4949-889d-629d577c094c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.894153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.895213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.895926 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.896222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] PATH_INFO: `/v3/users/157f318f0cd944e2ade222d32890151c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.919056 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=157f318f0cd944e2ade222d32890151c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.922228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.922414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e4ed7-2196-421f-b84d-f0f038ee4055 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:32.924737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 96/191] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/users/157f318f0cd944e2ade222d32890151c => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.925781 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:32.950511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:32.967290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:32.968530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:32.968874 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:32.969222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] PATH_INFO: `/v3/users/157f318f0cd944e2ade222d32890151c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:32.970593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] RBAC: Authorizing `identity:get_user(user_id=157f318f0cd944e2ade222d32890151c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:32.972065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:32.973701 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 96/192] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/users/157f318f0cd944e2ade222d32890151c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:32.974507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:33.049394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:33.068758 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f7cda-1626-4eee-b9b5-d4d9b31b0cc2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:33.101251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47bab-f825-4f65-80f3-68d857512abd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:33.111803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:33.113023 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.113525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.114022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] PATH_INFO: `/v3/projects/b105c4e39aa44792be3c3784c489412e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.115449 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=b105c4e39aa44792be3c3784c489412e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:33.117092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:33.119096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 97/193] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/projects/b105c4e39aa44792be3c3784c489412e => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:33.120133 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:33.147311 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:33.147962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.148242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.148516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.236598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:33.251348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:33.253514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:33.270188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b786a-455b-4147-930c-a502d8df9ad0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:33.331651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:33.332469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.332760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.333035 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.375878 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 97/194] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:33.376566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:33.378754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:33.463511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:33.465538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:33.501740 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:33.513142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789f50-fcfc-48f1-98b9-136072ac5e24 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:33.561371 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:33.562474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.562861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.563382 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.564608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=b105c4e39aa44792be3c3784c489412e, user.id=90ae04531d9d4084be238a8e8c7877d9) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:33.565244 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:33.568982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b58b-7474-4156-8d80-4b957d14e151 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:33.581931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 98/196] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:33.582863 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:33.585737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 98/196] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:33 2022] GET /identity/v3/role_assignments?user.id=90ae04531d9d4084be238a8e8c7877d9&scope.project.id=b105c4e39aa44792be3c3784c489412e&role.id=e11d9924ba394c088bd2aee20d352866 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:33.587265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc9a4-061e-4e79-b7e9-e106925caaec None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.587552 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc9a4-061e-4e79-b7e9-e106925caaec None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.587832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc9a4-061e-4e79-b7e9-e106925caaec None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.589858 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 99/197] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:33.593591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbc9a4-061e-4e79-b7e9-e106925caaec None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:33.718343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:33.791735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbc9a4-061e-4e79-b7e9-e106925caaec None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:33.817166 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358842-a6d2-402e-a6d3-1b81102d0366 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:33.875086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26d21d-3db9-4885-a1fc-1d7f33cfb7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:33.875951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d21d-3db9-4885-a1fc-1d7f33cfb7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.876234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d21d-3db9-4885-a1fc-1d7f33cfb7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.876508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26d21d-3db9-4885-a1fc-1d7f33cfb7a1 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.877714 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26d21d-3db9-4885-a1fc-1d7f33cfb7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:33.879322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26d21d-3db9-4885-a1fc-1d7f33cfb7a1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:33.880001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:33.880873 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.881152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.881400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 99/198] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:33 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:33.881502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.882594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:33.882724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:33.882893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:33.883158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:33.884104 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:33.885900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 100/199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:33 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:33.888938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:33.903076 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:33.904733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:33.920443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:34.005923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 100/200] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:34.006603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:34.015401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17355ec7-fdf4-4652-bb70-b1b7f96a6d87 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:34.056264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:34.057963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:34.059063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:34.059340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:34.060785 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=157f318f0cd944e2ade222d32890151c) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:34.061097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:34.062668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:34.068717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 101/201] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:33 2022] GET /identity/v3/role_assignments?user.id=157f318f0cd944e2ade222d32890151c&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:34.069506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:34.084096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:34.142764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3a2bd-47e7-4f21-bb5e-653ba9ecd933 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:34.168878 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:34.184433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:34.184955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd35ec-f783-4a08-b0d4-3f406cd9c73f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:34.185162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:34.185384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:34.185658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:34.186668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] RBAC: Adding query filter params (role.id=404a4769ebb543319b7a918411953668, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=157f318f0cd944e2ade222d32890151c) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:34.186989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:34.188585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:34.203134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 101/202] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:34 2022] GET /identity/v3/role_assignments?user.id=157f318f0cd944e2ade222d32890151c&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=404a4769ebb543319b7a918411953668 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:34.224522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:34.225495 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:34.225781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:34.226090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:34.239861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:34.248966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:34.251165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:34.252928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 102/203] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:34.257595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:34.431508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b40e4-a5ac-4c18-ac03-a94d9376b8d9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:34.447817 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:34.469643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:34.470375 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:34.470619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:34.470897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:34.471650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:34.471958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:34.473338 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:34.482722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 102/204] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:34.488100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:34.620085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17178e8-e9be-4783-9c26-2d10c1023d0f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:34.668528 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:34.669413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:34.669690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:34.669990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] PATH_INFO: `/v3/users/fa709de53ddb4803b650a98a81014c82` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:34.671218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] RBAC: Authorizing `identity:get_user(user_id=fa709de53ddb4803b650a98a81014c82)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:34.672932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:34.674862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 103/205] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:34 2022] GET /identity/v3/users/fa709de53ddb4803b650a98a81014c82 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:34.680151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:34.782434 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aee7d6-5e80-4f9e-bbf1-af2c10dbe9a8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:34.830031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:34.830690 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:34.830976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:34.831252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:34.884865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:34.910032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:34.911833 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:35.015824 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 103/206] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:35.021949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:35.064675 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:35.201806 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2e28-9a0d-4159-bb31-6e07e03ed680 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:35.253461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79073c7-22fb-485e-96ab-77d7a4b2dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:35.254366 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79073c7-22fb-485e-96ab-77d7a4b2dde9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.254651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79073c7-22fb-485e-96ab-77d7a4b2dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.254928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79073c7-22fb-485e-96ab-77d7a4b2dde9 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.256146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79073c7-22fb-485e-96ab-77d7a4b2dde9 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:35.257611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79073c7-22fb-485e-96ab-77d7a4b2dde9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:35.259659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 104/207] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:35 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:35.265781 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:35.391982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:35.422971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b99a-abc8-40cc-a1ee-dd7acc39c80f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:35.472937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:35.473700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.473883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.474191 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.475036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] RBAC: Adding query filter params (role.id=20c7e935f42040f295131da1f4c7a63f, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26, user.id=fa709de53ddb4803b650a98a81014c82) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:35.475348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:35.476822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d04f-b938-46a3-96b7-e01eeb54c0cc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:35.486516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 104/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:35 2022] GET /identity/v3/role_assignments?user.id=fa709de53ddb4803b650a98a81014c82&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=20c7e935f42040f295131da1f4c7a63f => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:35.562693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609fef2-7808-4d6a-976f-b0367e24f80f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.563044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609fef2-7808-4d6a-976f-b0367e24f80f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.563264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609fef2-7808-4d6a-976f-b0367e24f80f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.565003 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 105/209] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:35.572732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50360338-5b60-4b86-ab91-16782b021df3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.572732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50360338-5b60-4b86-ab91-16782b021df3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.572732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50360338-5b60-4b86-ab91-16782b021df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.591237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-50360338-5b60-4b86-ab91-16782b021df3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:35.592701 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-50360338-5b60-4b86-ab91-16782b021df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:35.678012 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 105/210] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:35.700996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609fef2-7808-4d6a-976f-b0367e24f80f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:35.818630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:35.833962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd86e-0a05-4513-a4f4-d1f849654b84 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.833962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd86e-0a05-4513-a4f4-d1f849654b84 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.834230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd86e-0a05-4513-a4f4-d1f849654b84 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.835433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 106/211] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:35.842892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.843175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.843446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.847850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609fef2-7808-4d6a-976f-b0367e24f80f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:35.864444 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:35.866134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:35.892150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:35.893744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:35.894283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:35.895007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:35.896539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:35.898806 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:35.906143 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 106/212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:35.908376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:35.953046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:35.965928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 107/213] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:35.984650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:36.046436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff47f-28e0-4e09-ac94-c04b83c05488 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:36.082598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:36.083210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.083553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.083828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.084595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:36.086211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:36.111349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8986-06e0-42cd-84ee-5b115640e7f3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:36.112302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 107/214] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:35 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:02:36.153700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:36.154912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.155396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.155894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.169286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:36.178087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:36.179020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:36.179783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:36.187435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 108/215] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:36.189287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:36.202670 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:36.314731 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2ab9-b8a1-45a7-863c-0560e5b1ef03 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:36.353019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:36.353706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.354027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.354291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.356152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:36.356469 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:36.357875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:36.367359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 108/216] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:36.374037 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:36.443898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:36.489303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34135ef-620e-45d5-a1c6-b45f3d080cfb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:36.528797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62714dec-cacc-4815-a094-8debb153af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:36.529975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714dec-cacc-4815-a094-8debb153af44 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.530420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714dec-cacc-4815-a094-8debb153af44 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.530841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714dec-cacc-4815-a094-8debb153af44 None admin] PATH_INFO: `/v3/users/2cb127c7e9d24341be8279a9d7ed4a28` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.546016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62714dec-cacc-4815-a094-8debb153af44 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb127c7e9d24341be8279a9d7ed4a28)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:36.547981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62714dec-cacc-4815-a094-8debb153af44 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:36.551193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 109/217] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:36 2022] GET /identity/v3/users/2cb127c7e9d24341be8279a9d7ed4a28 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:36.555906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:36.642181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:36.684816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30aad5-6710-44ae-8f67-91c7ec8a5bcb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:36.729377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb60b7d-b795-42fd-8ba1-c4f8d29e7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:36.730987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb60b7d-b795-42fd-8ba1-c4f8d29e7f98 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.731546 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb60b7d-b795-42fd-8ba1-c4f8d29e7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.732013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb60b7d-b795-42fd-8ba1-c4f8d29e7f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.818252 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb60b7d-b795-42fd-8ba1-c4f8d29e7f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:36.820119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb60b7d-b795-42fd-8ba1-c4f8d29e7f98 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:36.877133 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b15-3fa6-4324-bb19-41f8440aeaf8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.877352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b15-3fa6-4324-bb19-41f8440aeaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.877599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac419b15-3fa6-4324-bb19-41f8440aeaf8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.882015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 110/218] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:36.891874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550e556-c4db-42c2-959e-1140aaa2bf77 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.892158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550e556-c4db-42c2-959e-1140aaa2bf77 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.892490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550e556-c4db-42c2-959e-1140aaa2bf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.896544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:36.913508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b550e556-c4db-42c2-959e-1140aaa2bf77 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:36.915403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b550e556-c4db-42c2-959e-1140aaa2bf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:36.933814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 109/219] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:36.939585 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5715-d5eb-4c96-b65c-2091560fda91 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:36.939880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5715-d5eb-4c96-b65c-2091560fda91 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:36.940159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5715-d5eb-4c96-b65c-2091560fda91 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:36.941508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 110/220] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:36.943662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5715-d5eb-4c96-b65c-2091560fda91 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.004070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 111/221] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:37.005989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.006820 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.007564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.028891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:37.031001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:37.062661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5715-d5eb-4c96-b65c-2091560fda91 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.095031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.100552 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.101706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.102610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.103063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.104580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:37.106442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:37.108290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 111/222] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:36 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:37.109176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.127169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 112/223] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:37.134869 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.155763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.221452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c0029-40a3-48a0-8245-7210ce39a7b6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.259034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.259846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.260129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.260402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.265371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba65de-8a26-4dc4-8716-6b0217abffde None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.271625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:37.280832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:37.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 112/224] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:37.282992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.306809 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.308417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.308947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.309492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.310621 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=2cb127c7e9d24341be8279a9d7ed4a28) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:37.311080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:37.312737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:37.326090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 113/225] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/role_assignments?user.id=2cb127c7e9d24341be8279a9d7ed4a28&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=e11d9924ba394c088bd2aee20d352866 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:37.327523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.398356 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe73c6-fbf6-4845-a9b8-2a51153e3fdd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.399195 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.422036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.436839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.437653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.437953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.438228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.450331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:37.458763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:37.459749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:37.460788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 113/226] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:37.466529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.493337 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9300a-6e0a-495d-8c8c-9e2a077b7216 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.536595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.537731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.538191 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.538781 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.539672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:37.540144 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:37.541772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:37.553186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 114/227] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:37.560364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.580615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97839-0cb3-46fe-b1f5-8f67b11dd9f0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.620182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.626510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.626510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.626510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.626510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:37.626510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:37.626510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:37.645412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 114/228] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:37.651195 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.690256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.746940 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55f7f5-7631-4c25-a143-dfc0319e1533 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.750159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.783848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb2ed-ccd2-4165-a369-49006a8c46cd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.789729 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.790656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.790939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.791214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] PATH_INFO: `/v3/users/157f318f0cd944e2ade222d32890151c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.793357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] RBAC: Authorizing `identity:get_user(user_id=157f318f0cd944e2ade222d32890151c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:37.795082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:37.796975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 115/229] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/users/157f318f0cd944e2ade222d32890151c => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:37.802644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.826112 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:37.827386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:37.827890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:37.828433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] PATH_INFO: `/v3/users/157f318f0cd944e2ade222d32890151c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:37.829882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] RBAC: Authorizing `identity:get_user(user_id=157f318f0cd944e2ade222d32890151c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:37.831802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:37.834117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 115/230] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/users/157f318f0cd944e2ade222d32890151c => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:37.839979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:37.948294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:37.962351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259d8f4-4d08-4a32-be9a-93581983bf5f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:37.972187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6a783-538b-4b10-85f0-f1524e5b3f44 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:38.002682 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:38.004047 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.004971 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.005470 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.006875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:38.008535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:38.010742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 116/231] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:38.017948 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:38.053065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:38.055100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.057215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.057700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.060742 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:38.067702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:38.069580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 116/232] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:37 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:38.075570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:38.157928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad03b98-4abf-4f57-ac89-827eaa9cbc06 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:38.166790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:38.225082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891e42-86a1-4bda-bcf3-fa9a56efd146 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:38.231797 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e70076-59d8-4561-9db9-4e4d5102c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:38.232947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70076-59d8-4561-9db9-4e4d5102c6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.233439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70076-59d8-4561-9db9-4e4d5102c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.233940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70076-59d8-4561-9db9-4e4d5102c6c6 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5/users/157f318f0cd944e2ade222d32890151c/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.236149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e70076-59d8-4561-9db9-4e4d5102c6c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7215e66da950419a8b640eece36a4cb5, user_id=157f318f0cd944e2ade222d32890151c, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:38.237812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e70076-59d8-4561-9db9-4e4d5102c6c6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:38.261900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb89be-9184-497d-84a7-fe5853eb5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:38.263092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb89be-9184-497d-84a7-fe5853eb5821 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.263440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb89be-9184-497d-84a7-fe5853eb5821 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.263778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb89be-9184-497d-84a7-fe5853eb5821 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5/users/157f318f0cd944e2ade222d32890151c/roles/404a4769ebb543319b7a918411953668` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.266370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb89be-9184-497d-84a7-fe5853eb5821 None admin] RBAC: Authorizing `identity:create_grant(project_id=7215e66da950419a8b640eece36a4cb5, user_id=157f318f0cd944e2ade222d32890151c, role_id=404a4769ebb543319b7a918411953668)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:38.267927 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb89be-9184-497d-84a7-fe5853eb5821 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:38.275095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 117/233] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:38 2022] PUT /identity/v3/projects/7215e66da950419a8b640eece36a4cb5/users/157f318f0cd944e2ade222d32890151c/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:38.292895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 117/234] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:38 2022] PUT /identity/v3/projects/7215e66da950419a8b640eece36a4cb5/users/157f318f0cd944e2ade222d32890151c/roles/404a4769ebb543319b7a918411953668 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:02:38.894691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e0c7-228e-405f-a3d1-51a610318942 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.895203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e0c7-228e-405f-a3d1-51a610318942 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.895302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e0c7-228e-405f-a3d1-51a610318942 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.896943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 118/235] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:38.907502 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.907966 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.908153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.935280 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:38.936529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:38.996522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60ca14-dd22-4163-8d4f-2a5a656adf99 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:38.996873 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60ca14-dd22-4163-8d4f-2a5a656adf99 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:38.997090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60ca14-dd22-4163-8d4f-2a5a656adf99 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:38.998916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 119/236] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:39.012876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.013185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.013440 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:39.029244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 118/237] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:39.052098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:39.053005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:39.053235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:39.065156 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:39.102262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:39.175582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 120/238] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:39.211117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:39.220777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf1ae4-b750-4047-b4de-7af902b1e4f9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:39.267010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:39.267823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.268104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.268380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:39.288514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:39.296974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:39.298111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:39.298881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 119/239] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:39.312652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:39.417182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a3309-e457-40c6-a6b8-d4994c17b71e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:39.434410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81afeb-cedc-47fa-8d1f-2c596f128e2f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:39.438282 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:39.471129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:39.471800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.472096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.472373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:39.473228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:39.473545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:39.474284 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:39.474966 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:39.475530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.476001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.476466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:39.482669 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:39.484382 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:39.484591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 120/240] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:39.486574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 121/241] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:39.493961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:39.494089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:39.521191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:39.685701 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723751c5-8a70-4928-9742-c189aca00f1f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:39.689783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f8e41-a1d9-401c-b4f8-12273b35186c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:39.741224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:39.741930 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.742226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.742503 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:39.743236 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:39.744700 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:39.761889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:39.762790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.763070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.763344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] PATH_INFO: `/v3/users/3e9b187540914515a0c0608c15d19089` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:39.791839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] RBAC: Authorizing `identity:get_user(user_id=3e9b187540914515a0c0608c15d19089)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:39.794079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:39.796602 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 121/242] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:39 2022] GET /identity/v3/users/3e9b187540914515a0c0608c15d19089 => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:39.802096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 122/243] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:39 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:39.803202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:39.819326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:39.919178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62addbed-6994-44a5-9a0c-7eaa221818bc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:39.957477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2767db7-a6f5-4bbe-aa9f-97464cea3f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:39.958534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2767db7-a6f5-4bbe-aa9f-97464cea3f53 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:39.959021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2767db7-a6f5-4bbe-aa9f-97464cea3f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:39.959492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2767db7-a6f5-4bbe-aa9f-97464cea3f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.040360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2767db7-a6f5-4bbe-aa9f-97464cea3f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:40.042752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2767db7-a6f5-4bbe-aa9f-97464cea3f53 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:40.055759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:40.152710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 122/244] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:40.158430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:40.210699 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8a01-2252-4943-89fa-ad2f7dc6ea37 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.210991 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8a01-2252-4943-89fa-ad2f7dc6ea37 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.211173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8a01-2252-4943-89fa-ad2f7dc6ea37 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.212725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 123/245] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:40.219212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.219554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.219834 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.237645 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:40.238971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:40.253118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:40.300426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3ca35-d844-4b91-aaf3-90fee017e654 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:40.314602 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 124/246] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:40.338120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:40.346635 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:40.347733 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.348142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.348539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.349943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:40.351560 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:40.354120 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 123/247] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:40 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:40.362299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:40.394434 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:40.474058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510aa97-a27a-4045-91cd-96d982dc718e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:40.478618 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71957b-a426-4c5d-9927-cdb46f077a15 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:40.519947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:40.520742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.521008 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.521234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.522292 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] RBAC: Adding query filter params (role.id=20c7e935f42040f295131da1f4c7a63f, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=3e9b187540914515a0c0608c15d19089) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:40.522788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:40.524065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:40.526306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:40.527797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.528077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.528353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.535603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 124/248] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:40 2022] GET /identity/v3/role_assignments?user.id=3e9b187540914515a0c0608c15d19089&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=20c7e935f42040f295131da1f4c7a63f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:40.550165 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:40.559446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:40.560463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:40.561226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:40.564121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 125/249] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:40.569688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:40.581034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:40.700214 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aae8-2462-4f9d-8171-d37b50baf306 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:40.741931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:40.743003 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.743497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.743968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.744993 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:40.745755 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:40.747595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:40.758251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 125/250] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:40.765873 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:40.880911 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:40.884218 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb07f8f-2cbb-443f-a7ad-c7121a70bf20 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:40.921514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce695-cbca-4b51-bd8c-764850bd62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:40.922429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce695-cbca-4b51-bd8c-764850bd62eb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.922964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce695-cbca-4b51-bd8c-764850bd62eb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.923239 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce695-cbca-4b51-bd8c-764850bd62eb None admin] PATH_INFO: `/v3/users/2cb127c7e9d24341be8279a9d7ed4a28` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.924460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce695-cbca-4b51-bd8c-764850bd62eb None admin] RBAC: Authorizing `identity:get_user(user_id=2cb127c7e9d24341be8279a9d7ed4a28)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:40.925934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce695-cbca-4b51-bd8c-764850bd62eb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:40.927745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 126/251] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:40 2022] GET /identity/v3/users/2cb127c7e9d24341be8279a9d7ed4a28 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:40.933314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:40.989247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2804a67-fb3c-4503-b9b3-7ac9690803b2 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.989571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2804a67-fb3c-4503-b9b3-7ac9690803b2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.989823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2804a67-fb3c-4503-b9b3-7ac9690803b2 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:40.991499 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 127/252] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:40.997211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:40.997425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:40.997710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.015167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:41.016375 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:41.030248 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:41.095381 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69e075-b603-47b6-8e5a-67fd6daeb66a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:41.140019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 128/253] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:41.154777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:41.155654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.155942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.156224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.158613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:41.160143 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:41.162232 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 126/254] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:40 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:41.167805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:41.212657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:41.313284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:41.321781 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953903b-750e-43be-a9ca-9bfc3db5f47d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:41.349960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fab8aa-0820-413d-9983-65f4632985ad None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:41.382982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:41.395453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:41.396573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.397063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.397579 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.408583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:41.409498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.409949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.410241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5/users/2cb127c7e9d24341be8279a9d7ed4a28/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.412385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] RBAC: Authorizing `identity:create_grant(project_id=7215e66da950419a8b640eece36a4cb5, user_id=2cb127c7e9d24341be8279a9d7ed4a28, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:41.413852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:41.431326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:41.445935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:41.446912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:41.447685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:41.451826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 127/255] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:41.454040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 129/256] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:41 2022] PUT /identity/v3/projects/7215e66da950419a8b640eece36a4cb5/users/2cb127c7e9d24341be8279a9d7ed4a28/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:41.457282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:41.617890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c0ba-e6d8-4929-ad19-24087f48096a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:41.664959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:41.665664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.665979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.666269 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.667105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:41.667441 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:41.668898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e41c6a-7f28-4406-9c59-cc79d1acb718 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:41.681854 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 128/257] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:41.688736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:41.743288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684395dd-4ea5-449d-a342-6c955bce34fb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.743605 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684395dd-4ea5-449d-a342-6c955bce34fb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.743866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684395dd-4ea5-449d-a342-6c955bce34fb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.746097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 129/258] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:41.751556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.751848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.752133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.769519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:41.770800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:41.906348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:41.914395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9005-6fe2-4928-8326-2e0bcd2bf97f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:41.926265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 130/259] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:41.945201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:41.971850 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:41.972744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:41.973029 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:41.973407 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] PATH_INFO: `/v3/users/157f318f0cd944e2ade222d32890151c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:41.975670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] RBAC: Authorizing `identity:get_user(user_id=157f318f0cd944e2ade222d32890151c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:41.977547 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:41.980253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 130/260] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:41 2022] GET /identity/v3/users/157f318f0cd944e2ade222d32890151c => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:41.985794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:42.027370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:42.063287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb46e7-c446-4f21-ae85-a84cdfdda65d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:42.099776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:42.100925 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:42.101400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:42.101867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:42.113867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:42.122722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:42.123621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:42.124396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:42.126902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 131/261] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:42.130727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b209c4-bd42-41f7-9142-0d452bbc8181 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:42.132853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:42.185146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:42.209161 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:42.210203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:42.210636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:42.211085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:42.247957 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c962237-5f34-41e9-bcbf-bd484e1789e1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:42.290467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:42.291485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:42.291999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:42.292862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:42.293815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:42.294338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:42.296022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:42.305260 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 132/262] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:42.311507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:42.356492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:42.358138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:42.413569 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:42.423238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9baa5-c47e-4091-890d-494f0511e085 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:42.431052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:42.483972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:42.484768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:42.485046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:42.485316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] PATH_INFO: `/v3/users/157f318f0cd944e2ade222d32890151c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:42.487164 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] RBAC: Authorizing `identity:get_user(user_id=157f318f0cd944e2ade222d32890151c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:42.488609 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:42.491170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 133/263] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:42 2022] GET /identity/v3/users/157f318f0cd944e2ade222d32890151c => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:42.498247 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:42.574712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 131/264] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:02:42.580241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:42.710499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d7e26-3814-48cd-8232-331fc87921d5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:42.759867 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402fcf-ef97-4f8a-b695-2743d96f0aed None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:42.773783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:42.774785 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:42.775274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:42.775776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:42.829177 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:42.853765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:42.855759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:42.856442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:42.858773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:42.860533 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:42.868862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:42.873275 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 132/265] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:42 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:42.878905 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:42.883903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:42.951023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:42.953470 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:43.137782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99a692-6db7-4044-b962-790946e5016d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:43.209285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 134/266] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:02:43.215706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:43.220650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:43.221324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.221610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.222032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.222879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] RBAC: Adding query filter params (role.id=404a4769ebb543319b7a918411953668, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=157f318f0cd944e2ade222d32890151c) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:43.223192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:43.224642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:43.253955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 133/267] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:42 2022] GET /identity/v3/role_assignments?user.id=157f318f0cd944e2ade222d32890151c&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=404a4769ebb543319b7a918411953668 => generated 608 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:43.366725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:43.410062 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb987c2-f2f3-4e76-88e1-c0a3569ff664 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:43.463658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6515804-33d9-45e5-b604-e44ef777d716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:43.464781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515804-33d9-45e5-b604-e44ef777d716 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.465059 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515804-33d9-45e5-b604-e44ef777d716 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.465336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515804-33d9-45e5-b604-e44ef777d716 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.466648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515804-33d9-45e5-b604-e44ef777d716 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:43.468154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515804-33d9-45e5-b604-e44ef777d716 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:43.469933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 135/268] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:43 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:43.476156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:43.552485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:43.606359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fca13-78ad-493c-b03f-133a57b1230c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:43.644723 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60fbdc-e3d8-425f-8bfe-a4841d99c503 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.646408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60fbdc-e3d8-425f-8bfe-a4841d99c503 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.647120 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60fbdc-e3d8-425f-8bfe-a4841d99c503 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.653956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:43.654176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 136/269] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:43.654258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.654258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.654258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.654258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=157f318f0cd944e2ade222d32890151c) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:43.654258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:43.654258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:43.656947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbece66-9c1e-49e3-824a-ebb6a9b7ec7f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.657451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbece66-9c1e-49e3-824a-ebb6a9b7ec7f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.657956 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbece66-9c1e-49e3-824a-ebb6a9b7ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.664990 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 134/270] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:43 2022] GET /identity/v3/role_assignments?user.id=157f318f0cd944e2ade222d32890151c&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:43.684398 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fcbece66-9c1e-49e3-824a-ebb6a9b7ec7f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:43.685759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fcbece66-9c1e-49e3-824a-ebb6a9b7ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:43.776429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 137/271] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:43.815553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:43.902238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d175f-fde5-4b2e-acbb-346e6ad42881 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.902898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d175f-fde5-4b2e-acbb-346e6ad42881 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.902898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d175f-fde5-4b2e-acbb-346e6ad42881 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.904528 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 138/272] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:43.915535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.915820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.916033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.945211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703ced5-d163-4851-8e45-bc6ef8cb53a2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:43.946401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:43.947599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:43.975112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:43.984122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:43.985134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:43.985521 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:43.985805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:43.999109 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:44.007985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:44.009025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:44.010022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:44.012473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 135/273] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:44.018391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.022716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 139/274] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:44.047143 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.049798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.166829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258fc8e-a18c-4a18-afd4-db6f2fdaa947 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.193742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112e41a-f0a6-40bd-ab89-c16e43f296c9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.218226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.219234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.219697 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.220151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.221110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:44.221601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.223206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.238021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.239053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.239349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.239665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.240943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 136/275] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:44.250245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.257892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:44.267580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:44.268499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:44.269389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 140/276] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:44.274714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.311718 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.343819 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.372158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48256de-719d-4ef6-b16f-80abcef80b3d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.389501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3b07-b238-45b0-b663-417a8afd9807 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.407295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f516250-c713-4bc9-b7c0-b416e0decc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.408151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516250-c713-4bc9-b7c0-b416e0decc51 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.408434 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516250-c713-4bc9-b7c0-b416e0decc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.408706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f516250-c713-4bc9-b7c0-b416e0decc51 None admin] PATH_INFO: `/v3/users/3e9b187540914515a0c0608c15d19089` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.409879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f516250-c713-4bc9-b7c0-b416e0decc51 None admin] RBAC: Authorizing `identity:get_user(user_id=3e9b187540914515a0c0608c15d19089)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.411387 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f516250-c713-4bc9-b7c0-b416e0decc51 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.413274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 137/277] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/users/3e9b187540914515a0c0608c15d19089 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:44.414354 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf628d-c5ab-49d5-8506-4775ddcc8889 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.414639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf628d-c5ab-49d5-8506-4775ddcc8889 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.414914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf628d-c5ab-49d5-8506-4775ddcc8889 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.416241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 138/278] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:44.422421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf628d-c5ab-49d5-8506-4775ddcc8889 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.431382 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.432054 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.432336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.432643 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.434079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:44.434395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.435808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58437281-6b32-4d77-994c-74ed00dbb1ed None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.444576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 141/279] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:44.445604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.445890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.446192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.465201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:44.466443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:44.538735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf628d-c5ab-49d5-8506-4775ddcc8889 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.539046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 142/280] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:44.546883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.554763 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.578522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.579394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.579680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.579959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.581149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.582653 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.584508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 139/281] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:44.586814 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.607616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.658183 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b8bc9-598f-47ef-90b5-35bb5d601ab2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.694764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627d06-6b9d-4f25-9473-a8c1cfa1c50d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.697228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.698130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.699055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.699335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] PATH_INFO: `/v3/users/dea68022963241bd84e08dff74e2b99f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.713866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] RBAC: Authorizing `identity:get_user(user_id=dea68022963241bd84e08dff74e2b99f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.715699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.717380 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 143/282] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/users/dea68022963241bd84e08dff74e2b99f => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:44.718149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.731467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6976f-7caa-446e-a66c-4d4c580cefec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.732260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6976f-7caa-446e-a66c-4d4c580cefec None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.732596 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6976f-7caa-446e-a66c-4d4c580cefec None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.732873 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6976f-7caa-446e-a66c-4d4c580cefec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.734088 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6976f-7caa-446e-a66c-4d4c580cefec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.735534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6976f-7caa-446e-a66c-4d4c580cefec None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.737148 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 140/283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:44.738333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245f9b-4543-4540-929d-9d0e36d64410 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.738707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245f9b-4543-4540-929d-9d0e36d64410 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.739058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245f9b-4543-4540-929d-9d0e36d64410 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.740461 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 141/284] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:44.741019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245f9b-4543-4540-929d-9d0e36d64410 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.795646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.819827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7205839-0f62-4dcb-850b-7a7957e02ead None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.832826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:44.849775 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245f9b-4543-4540-929d-9d0e36d64410 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:44.854126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.855198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.855475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.855751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5/users/3e9b187540914515a0c0608c15d19089/roles/20c7e935f42040f295131da1f4c7a63f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.857720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] RBAC: Authorizing `identity:create_grant(project_id=7215e66da950419a8b640eece36a4cb5, user_id=3e9b187540914515a0c0608c15d19089, role_id=20c7e935f42040f295131da1f4c7a63f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.859212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.872952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 144/285] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:02:44 2022] PUT /identity/v3/projects/7215e66da950419a8b640eece36a4cb5/users/3e9b187540914515a0c0608c15d19089/roles/20c7e935f42040f295131da1f4c7a63f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:44.873813 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:44.890600 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:44.891727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.891727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.891924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.892683 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, user.id=dea68022963241bd84e08dff74e2b99f, scope.system=all) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:44.892996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:44.894555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047021d-042d-495e-89c4-faad96d48c5c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:44.900438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 142/286] 10.222.0.30 () {56 vars in 1308 bytes} [Tue May 24 09:02:44 2022] GET /identity/v3/role_assignments?user.id=dea68022963241bd84e08dff74e2b99f&scope.system=all&role.id=e11d9924ba394c088bd2aee20d352866 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:44.901995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:44.902279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:44.902553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:44.921086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:44.922380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:45.018391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 143/287] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:45.026110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71c224-09cb-4cc0-884b-34349188ef6b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:45.043002 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:45.069114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:45.069818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:45.070138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:45.070418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:45.071250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:45.073001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:45.099895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 145/288] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:02:44 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:45.113712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:45.181819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ef1e-7f43-4912-b26c-b56cfcb15bb3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:45.226395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:45.227216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:45.227505 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:45.227785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:45.241864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:45.250532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:45.251477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:45.252293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:45.255414 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 144/289] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:45.258404 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:45.290324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:45.371028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b556b-1c3a-4772-8274-65a4d22c05d3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:45.407041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:45.407723 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:45.408010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:45.408288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:45.409049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:45.409355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:45.410768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:45.420451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 146/290] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:45.426162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:45.548947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc7f2-4f48-4523-9778-d8c3f199bb55 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:45.550502 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:45.590078 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:45.591013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:45.591297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:45.591573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] PATH_INFO: `/v3/users/2cb127c7e9d24341be8279a9d7ed4a28` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:45.593208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb127c7e9d24341be8279a9d7ed4a28)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:45.594709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:45.598706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 145/291] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:45 2022] GET /identity/v3/users/2cb127c7e9d24341be8279a9d7ed4a28 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:45.602324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:45.708448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:45.718728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba28aa-37c6-4bfe-b85c-562dfa8fe24c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:45.757984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:45.758643 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:45.758926 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:45.759201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:45.831444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:45.832868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:45.925324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:45.936310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 147/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:45.943182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:46.078008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941c63e-f3cf-4b85-be71-f999a6b76638 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:46.124610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fcad0-3d5d-4013-9779-1e74af561278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:46.125397 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fcad0-3d5d-4013-9779-1e74af561278 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:46.125678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fcad0-3d5d-4013-9779-1e74af561278 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:46.125978 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fcad0-3d5d-4013-9779-1e74af561278 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:46.127223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fcad0-3d5d-4013-9779-1e74af561278 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:46.128702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fcad0-3d5d-4013-9779-1e74af561278 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:46.130707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 146/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:45 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:46.137110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:46.286621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61215b65-60d5-4722-8883-6f204ffcb47f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:46.322445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:46.323111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:46.323454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:46.323736 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:46.324573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=2cb127c7e9d24341be8279a9d7ed4a28) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:46.324887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:46.326393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa7d8a-95c4-4f30-b41e-9e67c3238076 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:46.333265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 148/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:46 2022] GET /identity/v3/role_assignments?user.id=2cb127c7e9d24341be8279a9d7ed4a28&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=e11d9924ba394c088bd2aee20d352866 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:47.420215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e81e-4b95-4f08-9eee-0b0f17e8b656 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.420785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e81e-4b95-4f08-9eee-0b0f17e8b656 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.420785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e81e-4b95-4f08-9eee-0b0f17e8b656 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.422188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 147/295] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:47.427891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe884c-85a1-4f5e-80de-2157829b4ff8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.428300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe884c-85a1-4f5e-80de-2157829b4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.428448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe884c-85a1-4f5e-80de-2157829b4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.446101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5dfe884c-85a1-4f5e-80de-2157829b4ff8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:47.447314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5dfe884c-85a1-4f5e-80de-2157829b4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:47.505617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:47.524485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 149/296] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:47.548316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e81e-4b95-4f08-9eee-0b0f17e8b656 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:47.549160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87551-4870-4575-b0b2-994f1c04cb67 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.549448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87551-4870-4575-b0b2-994f1c04cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.549727 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87551-4870-4575-b0b2-994f1c04cb67 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.551757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 150/297] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:02:47.558683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878965-f460-48ca-a858-8a625194df44 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.559645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878965-f460-48ca-a858-8a625194df44 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.559941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878965-f460-48ca-a858-8a625194df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.582543 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-86878965-f460-48ca-a858-8a625194df44 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:47.583995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-86878965-f460-48ca-a858-8a625194df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:47.601008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:47.674216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e81e-4b95-4f08-9eee-0b0f17e8b656 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:47.686004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 151/298] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:02:47.712167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878965-f460-48ca-a858-8a625194df44 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:47.717428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:47.718438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.718826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.719225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.730241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:47.738601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:47.739706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:47.740702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:47.743589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 148/299] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:47.749101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:47.841813 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878965-f460-48ca-a858-8a625194df44 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:47.857944 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:47.858874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:47.862947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4dac0-556a-4df6-85b2-ba34f5b27f2a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:47.882412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f145a8-a5a5-422f-a341-65bbffc2ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:47.883213 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f145a8-a5a5-422f-a341-65bbffc2ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.883501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f145a8-a5a5-422f-a341-65bbffc2ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.883778 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f145a8-a5a5-422f-a341-65bbffc2ed4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.894486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f145a8-a5a5-422f-a341-65bbffc2ed4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:47.898960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:47.899619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.899897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.900168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.900913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:47.901715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f1f145a8-a5a5-422f-a341-65bbffc2ed4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:47.902864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:47.903724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:47.909527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:47.910797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fa9c2-ebb6-48b0-b2f4-50f747f4b1c8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:47.910870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 152/300] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:47.910870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af28e-967c-4a1f-af3e-766f3d70326e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.910870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af28e-967c-4a1f-af3e-766f3d70326e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.910870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af28e-967c-4a1f-af3e-766f3d70326e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.910870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 153/301] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:47.912481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af28e-967c-4a1f-af3e-766f3d70326e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:47.916707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 149/302] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:47.918183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:47.918601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:47.918978 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:47.937002 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:47.938121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:48.005244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 150/303] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:48.006121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.024020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af28e-967c-4a1f-af3e-766f3d70326e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.060163 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.060946 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.061297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.061641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.062488 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:48.062807 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.064192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f057e70-ad43-4242-b4ed-ddf93c5c416e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.073087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 154/304] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.074393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ae8f-d54d-428b-95d3-42733f3120f0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.074684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ae8f-d54d-428b-95d3-42733f3120f0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.074963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86ae8f-d54d-428b-95d3-42733f3120f0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.076194 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 155/305] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:48.076893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86ae8f-d54d-428b-95d3-42733f3120f0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.096227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.107240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c9ece-2b61-432a-9bcb-1c59773a494f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.114661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.141492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.142400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.142689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.142968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] PATH_INFO: `/v3/users/3e9b187540914515a0c0608c15d19089` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.144155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] RBAC: Authorizing `identity:get_user(user_id=3e9b187540914515a0c0608c15d19089)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.145602 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.147263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 151/306] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/users/3e9b187540914515a0c0608c15d19089 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.149200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.181493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86ae8f-d54d-428b-95d3-42733f3120f0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.216898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15e16c-33d9-4a41-b32e-feddeaa45084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.217619 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15e16c-33d9-4a41-b32e-feddeaa45084 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.217895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15e16c-33d9-4a41-b32e-feddeaa45084 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.218203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15e16c-33d9-4a41-b32e-feddeaa45084 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.228136 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15e16c-33d9-4a41-b32e-feddeaa45084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1d15e16c-33d9-4a41-b32e-feddeaa45084 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:48.236066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:48.236945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:48.237750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 156/307] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:48.238849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.238916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.239178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.252259 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463660d7-f01a-47b6-8ef2-fe048554fd4e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.255884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:48.257064 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:48.288176 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.289045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.289327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.289601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] PATH_INFO: `/v3/users/dea68022963241bd84e08dff74e2b99f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.290810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] RBAC: Authorizing `identity:get_user(user_id=dea68022963241bd84e08dff74e2b99f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.292374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.293886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 152/308] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/users/dea68022963241bd84e08dff74e2b99f => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.294673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.320696 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.327450 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 157/309] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:48.328280 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.357809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.395303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97469a5-58c2-4a31-b3f5-9e452a7a7b41 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.430192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7917ace-3604-4742-a2d8-87fe1310ee90 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.430676 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.431042 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.431249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.431529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.463300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.464476 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.464756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.465066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.465799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:48.466133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.467562 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.480066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 158/310] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.480066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.500397 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.501859 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.532512 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.565872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.579820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031563-0c08-45ea-8f2a-9792d8bb8f63 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.607606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 153/311] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:48.608447 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.616822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.617681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.617998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.618276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] PATH_INFO: `/v3/system/users/dea68022963241bd84e08dff74e2b99f/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.619750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dea68022963241bd84e08dff74e2b99f, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.622207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.631499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 159/312] 10.222.0.30 () {58 vars in 1334 bytes} [Tue May 24 09:02:48 2022] PUT /identity/v3/system/users/dea68022963241bd84e08dff74e2b99f/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:48.632296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.721560 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71850546-1e78-4868-9e72-a5d3b1fa7684 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.751611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.759859 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8085-b7ce-49f1-b1c4-de2eb2b034d1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.761432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.762297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.762581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.763719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.764125 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.765597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.767487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 154/313] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.768107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.815546 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.816807 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.817091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.817365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] PATH_INFO: `/v3/users/199562524780486db37016504937d020` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.834152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] RBAC: Authorizing `identity:get_user(user_id=199562524780486db37016504937d020)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.835604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.837319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 160/314] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/users/199562524780486db37016504937d020 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.838087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.851646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:48.883370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55507eaf-08f8-4617-9c1d-fc191641aaea None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.920280 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:48.921145 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:48.921431 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:48.921693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:48.923186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:48.924621 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:48.926343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 155/315] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:48.927100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:48.954527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff5704-6cbd-4a79-abb0-f77413587734 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:48.992054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:49.002286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:49.003984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:49.004448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:49.004921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] PATH_INFO: `/v3/groups` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:49.005779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:49.007523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:49.022251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 161/316] 10.222.0.30 () {60 vars in 1134 bytes} [Tue May 24 09:02:48 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:49.023369 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:49.053527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5652-abfb-49e2-85d7-3dd78271c8f8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:49.100728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:49.101550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:49.101946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:49.102378 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:49.103435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] RBAC: Adding query filter params (role.id=20c7e935f42040f295131da1f4c7a63f, user.id=199562524780486db37016504937d020, scope.system=all) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:49.103900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:49.106320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892da1-c7f0-4808-9979-87ca55b4c68e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:49.113056 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 156/317] 10.222.0.30 () {56 vars in 1308 bytes} [Tue May 24 09:02:48 2022] GET /identity/v3/role_assignments?user.id=199562524780486db37016504937d020&scope.system=all&role.id=20c7e935f42040f295131da1f4c7a63f => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:49.127861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:49.171325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b30c7e-2cd2-4957-8c6d-203c134dfb27 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:49.221131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:49.221857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:49.222170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:49.222446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:49.223335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] RBAC: Adding query filter params (role.id=20c7e935f42040f295131da1f4c7a63f, scope.project.id=7215e66da950419a8b640eece36a4cb5, user.id=3e9b187540914515a0c0608c15d19089) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:49.223650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:49.225347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0978df-06de-4e17-ad17-33f36343317c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:49.232712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 162/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:02:49 2022] GET /identity/v3/role_assignments?user.id=3e9b187540914515a0c0608c15d19089&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=20c7e935f42040f295131da1f4c7a63f => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:50.891428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a19a-a8bb-486b-b6ae-9d5bcd74e3bf None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:50.891971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a19a-a8bb-486b-b6ae-9d5bcd74e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:50.891971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1a19a-a8bb-486b-b6ae-9d5bcd74e3bf None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:50.893349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 157/319] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:50.898617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:50.898997 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:50.899186 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:50.916505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:50.918363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:50.988365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 163/320] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:51.011404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a19a-a8bb-486b-b6ae-9d5bcd74e3bf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.117361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1a19a-a8bb-486b-b6ae-9d5bcd74e3bf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.150061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:51.161069 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beae40f-dbac-4148-9306-962ece122d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.161875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae40f-dbac-4148-9306-962ece122d8d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.162187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae40f-dbac-4148-9306-962ece122d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.162465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beae40f-dbac-4148-9306-962ece122d8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.173643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beae40f-dbac-4148-9306-962ece122d8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9beae40f-dbac-4148-9306-962ece122d8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:51.181509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:51.182698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:51.183493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:51.186232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 158/321] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:51.188876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.251598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:51.291322 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738de240-e4ca-4b8a-8715-c6700931be18 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.314424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48031-f197-4f20-96f6-1169eed79acb None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.314726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48031-f197-4f20-96f6-1169eed79acb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.314996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48031-f197-4f20-96f6-1169eed79acb None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.317947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 159/322] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:51.321316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ff6a-111b-4d07-ba29-2d17130450c2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.321777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ff6a-111b-4d07-ba29-2d17130450c2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.322216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ff6a-111b-4d07-ba29-2d17130450c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.328460 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.329158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.329443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.329717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.330500 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:51.330806 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:51.332182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65324778-6be9-47c3-be6d-65b10ba37011 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:51.340209 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-abd5ff6a-111b-4d07-ba29-2d17130450c2 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:51.340887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 164/323] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:51.341420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-abd5ff6a-111b-4d07-ba29-2d17130450c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:51.342128 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901e65-4b08-42cd-95fa-218690523e31 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.342419 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901e65-4b08-42cd-95fa-218690523e31 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.342695 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7901e65-4b08-42cd-95fa-218690523e31 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.343924 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 165/324] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:51.347027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901e65-4b08-42cd-95fa-218690523e31 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.410742 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 160/325] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:51.411947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.412238 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.412518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.430134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:51.431327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:51.451678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7901e65-4b08-42cd-95fa-218690523e31 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.477056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:51.486658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.487522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.487808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.488083 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] PATH_INFO: `/v3/users/dea68022963241bd84e08dff74e2b99f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.489257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] RBAC: Authorizing `identity:get_user(user_id=dea68022963241bd84e08dff74e2b99f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:51.490697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:51.492300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 166/326] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/users/dea68022963241bd84e08dff74e2b99f => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:51.493046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.505192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 161/327] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:51.506063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.555883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:51.600997 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c9776-721a-4a5c-b8ef-064f58a8244c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.617633 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8ec84-e3ee-44aa-b774-1de3ca43cb41 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.634282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.635072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.635348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.635653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.636868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:51.638349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:51.640011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 167/328] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:51.640764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.652159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.652803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.653090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.653365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.654230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] RBAC: Adding query filter params (role.id=e11d9924ba394c088bd2aee20d352866, user.id=dea68022963241bd84e08dff74e2b99f, scope.system=all) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:51.654542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:51.655996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:51.667812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 162/329] 10.222.0.30 () {56 vars in 1308 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/role_assignments?user.id=dea68022963241bd84e08dff74e2b99f&scope.system=all&role.id=e11d9924ba394c088bd2aee20d352866 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:51.668520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.730938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:51.784278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49dd2-531b-473b-be0a-5106d92a27f4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.784832 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead3102-21ea-4f8a-81b3-a9f7ecc3e484 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:51.789031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:51.826942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.827626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.827915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.828195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] PATH_INFO: `/v3/groups` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.828513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:51.828898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:51.829319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:51.829603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:51.829879 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:51.830431 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:51.843401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:51.848505 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 163/330] 10.222.0.30 () {60 vars in 1134 bytes} [Tue May 24 09:02:51 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:51.852424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:51.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:51.856570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 168/331] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:51.862943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:51.975779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b4f9b-2180-40e3-9fba-1e74c6814bb3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:52.012086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:52.012765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:52.013065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:52.013342 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:52.014129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:52.014437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:52.015856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:52.025104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 164/332] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:52.031000 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:52.145006 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530ef9c-a6c6-462d-8fad-a2d3c9e6335d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:52.169447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:52.182825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70798-85a3-4e1e-897f-a6b5aae8c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:52.183801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70798-85a3-4e1e-897f-a6b5aae8c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:52.184080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70798-85a3-4e1e-897f-a6b5aae8c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:52.184363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70798-85a3-4e1e-897f-a6b5aae8c6d2 None admin] PATH_INFO: `/v3/users/199562524780486db37016504937d020` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:52.185578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a70798-85a3-4e1e-897f-a6b5aae8c6d2 None admin] RBAC: Authorizing `identity:get_user(user_id=199562524780486db37016504937d020)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:52.187084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a70798-85a3-4e1e-897f-a6b5aae8c6d2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:52.188722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 169/333] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:52 2022] GET /identity/v3/users/199562524780486db37016504937d020 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:52.194222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:52.225261 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:52.308779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e3316-a116-4130-881a-9f4c64483c6f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:52.347001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1576eef-f69d-458e-a9f1-ee2c653cff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:52.348241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1576eef-f69d-458e-a9f1-ee2c653cff11 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:52.348736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1576eef-f69d-458e-a9f1-ee2c653cff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:52.349227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1576eef-f69d-458e-a9f1-ee2c653cff11 None admin] PATH_INFO: `/v3/system/users/199562524780486db37016504937d020/roles/20c7e935f42040f295131da1f4c7a63f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:52.351005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1576eef-f69d-458e-a9f1-ee2c653cff11 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=199562524780486db37016504937d020, role_id=20c7e935f42040f295131da1f4c7a63f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:52.352593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1576eef-f69d-458e-a9f1-ee2c653cff11 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:52.366932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 165/334] 10.222.0.30 () {58 vars in 1334 bytes} [Tue May 24 09:02:52 2022] PUT /identity/v3/system/users/199562524780486db37016504937d020/roles/20c7e935f42040f295131da1f4c7a63f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:02:54.304114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bad5e-3008-46f4-84e9-901ba44e534d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:54.304647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bad5e-3008-46f4-84e9-901ba44e534d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:54.304647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bad5e-3008-46f4-84e9-901ba44e534d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:54.306414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 170/335] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:54.312634 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:54.313107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:54.313285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:54.335372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:54.336562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:54.435523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 166/336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:54.475152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bad5e-3008-46f4-84e9-901ba44e534d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:54.615919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bad5e-3008-46f4-84e9-901ba44e534d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:54.661829 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:54.662674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:54.664722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:54.665009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:54.679083 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:54.687536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:54.688475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:54.689688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 171/337] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:54.696499 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:54.730717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:54.848143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855376d9-53e3-40b6-a113-81623ef0542e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:54.895709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:54.896309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:54.896592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:54.896868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:54.897628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:54.897954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:54.899354 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31afbc-31e0-4be4-a696-d68a48578128 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:54.913938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 167/338] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:54.920233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:54.935852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887afee-0abd-45f2-842f-37b2334de814 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:54.936164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887afee-0abd-45f2-842f-37b2334de814 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:54.936400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887afee-0abd-45f2-842f-37b2334de814 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:54.937770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 168/339] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:54.943968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:54.944253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:54.944532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:54.984693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:54.985886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:55.014007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.093710 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1acfe7-b982-46ec-a0ef-d3b4ab33b707 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:55.128096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 169/340] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:55.138809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:55.139470 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.139757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.140035 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.169792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:55.194303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.212746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:55.215684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:55.270305 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.330354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 172/341] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:55.336393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:55.343929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdcb25-d1ed-4e9f-bde9-f7cdf00fe9e9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:55.431618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:55.431618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.431618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.431618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.451588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:55.459819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:55.460712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:55.466244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 170/342] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:55.466906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaac408-cd65-4f0a-9340-8ad36329b550 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:55.470519 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:55.504187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:55.505070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.505352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.505632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.507028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:55.508479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:55.511058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 173/343] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:55 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:55.516721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:55.546422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.578625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.610877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed684ce-e58f-4f52-9761-3a34a8184aca None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:55.653073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb279a7-ce2e-4181-84f3-1c8f066da5bd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:55.660871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:55.661657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.662058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.662410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.663242 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:55.663616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:55.665554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8247b0-4213-424d-814d-203d2904e13f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:55.680330 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 171/344] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:55.681917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d69643-5935-4dfd-8f20-54be6de5f9c6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.682371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d69643-5935-4dfd-8f20-54be6de5f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.682715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d69643-5935-4dfd-8f20-54be6de5f9c6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.684762 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 172/345] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:55.689772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d69643-5935-4dfd-8f20-54be6de5f9c6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:55.704213 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dd1b-030f-4116-86ef-82827354dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:55.705215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dd1b-030f-4116-86ef-82827354dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.705500 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dd1b-030f-4116-86ef-82827354dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.705774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dd1b-030f-4116-86ef-82827354dd72 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.713125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446dd1b-030f-4116-86ef-82827354dd72 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:55.715508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446dd1b-030f-4116-86ef-82827354dd72 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:55.717225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 174/346] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:02:55 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:55.718554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.718844 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.719126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.740617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:55.741803 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:55.821018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d69643-5935-4dfd-8f20-54be6de5f9c6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:55.848358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 175/347] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:55.854130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:55.871795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ee721-233a-45ee-8392-1e95e5bc60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:55.872506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ee721-233a-45ee-8392-1e95e5bc60a0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:55.872840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ee721-233a-45ee-8392-1e95e5bc60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:55.873121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ee721-233a-45ee-8392-1e95e5bc60a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:55.878221 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.888351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:55.973488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ee721-233a-45ee-8392-1e95e5bc60a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:55.975894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ee721-233a-45ee-8392-1e95e5bc60a0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.008332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d73f97-c591-43ac-91e7-afee0a85c1b7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.057732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.059038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.060071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.060531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.061847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:56.062506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:56.064963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47811052-d28f-4e92-8e94-fef3b4f65d4d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.072616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 176/348] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:02:55 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=e11d9924ba394c088bd2aee20d352866 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:56.074206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa18626-1734-4260-b49d-5b2232249257 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.074935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa18626-1734-4260-b49d-5b2232249257 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.075392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa18626-1734-4260-b49d-5b2232249257 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.077863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 177/349] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:56.078934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa18626-1734-4260-b49d-5b2232249257 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.107080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 173/350] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:56.108621 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.108977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.109324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.133373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:56.134770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:56.188447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:56.190404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:56.236855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa18626-1734-4260-b49d-5b2232249257 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.276201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 174/351] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:56.277211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.319264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.320083 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.320361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.320631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.344280 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:56.353076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:56.354556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:02:56.355385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:56.355991 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 178/352] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:56.356827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.425096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52edc0-615a-42b1-a216-6cced540a337 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.462680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.463761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.464613 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.464902 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.466182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:56.467644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.469666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 175/353] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:56.470476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.480963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770afd-f4ef-444a-ae39-065d91bb0820 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.518009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:56.524407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278a8f-e34b-4657-a53e-d66af037bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.525650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278a8f-e34b-4657-a53e-d66af037bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.526005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278a8f-e34b-4657-a53e-d66af037bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.527029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278a8f-e34b-4657-a53e-d66af037bcf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.531674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:56.547512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be278a8f-e34b-4657-a53e-d66af037bcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-be278a8f-e34b-4657-a53e-d66af037bcf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:56.555816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:56.557989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 179/354] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:56.559906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db016f2-5d09-4a7b-adca-d0b2addf920f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.561681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db016f2-5d09-4a7b-adca-d0b2addf920f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.561681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db016f2-5d09-4a7b-adca-d0b2addf920f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.561681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 180/355] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:56.566017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db016f2-5d09-4a7b-adca-d0b2addf920f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.588178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cf536-9f62-4e67-baee-2798f80fa7f6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.627027 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.627697 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.627976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.628249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.628993 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:56.629298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:56.630723 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4686f3-06bf-441e-a5bb-f3224d5467fc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.641011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 176/356] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:56.642212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.642417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.660504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:56.661684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:56.680624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db016f2-5d09-4a7b-adca-d0b2addf920f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.719641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.720514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.720799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.721077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.722519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:56.723984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.726119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 181/357] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:56.726712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.747061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 177/358] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:56.748071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.776878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:56.805935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:56.850288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fa004-58c2-4bb9-997d-688250097e60 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.866698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca61bc7-3e7b-48c0-a789-b902433392e5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:56.890653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.891332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.891618 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.891895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.892757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:56.893072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:56.894568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.904754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 182/359] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:56.905703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:56.911705 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:56.912580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:56.912912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:56.913187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] PATH_INFO: `/v3/users/199562524780486db37016504937d020` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:56.914424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] RBAC: Authorizing `identity:get_user(user_id=199562524780486db37016504937d020)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:56.915883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:56.918438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 178/360] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/users/199562524780486db37016504937d020 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:56.919126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.017995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baec61-fa50-4b01-85e5-9ca2ea08e9f9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.032052 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.046183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20e7f7-6bd7-4a19-bb47-e4f8a51d8734 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.049250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.062474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.063389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.063797 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.064191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.065176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=404a4769ebb543319b7a918411953668, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:57.065630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:57.067128 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:57.073941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 183/361] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=404a4769ebb543319b7a918411953668 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:57.074764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.091555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.092493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.092657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.092931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.107728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:57.116344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:57.117345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:57.118181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 179/362] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:57.118833 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.206941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437209e-1d9a-4c9d-8283-483dca08a6b6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.246974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe18fce-6884-452e-95d7-9dc7745395fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.248021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe18fce-6884-452e-95d7-9dc7745395fa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.248534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe18fce-6884-452e-95d7-9dc7745395fa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.249015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe18fce-6884-452e-95d7-9dc7745395fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.259244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751f6c0-a31f-47cc-a299-6562e5b3a2ee None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.300616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.301200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.301484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.301760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.302738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] RBAC: Adding query filter params (role.id=20c7e935f42040f295131da1f4c7a63f, user.id=199562524780486db37016504937d020, scope.system=all) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:57.303049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:57.304588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1bfba-6424-4ff2-9abc-c565ec65b410 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:57.316390 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.319909 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 180/363] 10.222.0.30 () {56 vars in 1308 bytes} [Tue May 24 09:02:57 2022] GET /identity/v3/role_assignments?user.id=199562524780486db37016504937d020&scope.system=all&role.id=20c7e935f42040f295131da1f4c7a63f => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:57.321242 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404b50-9100-4513-93ba-04bb38eba074 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.321529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404b50-9100-4513-93ba-04bb38eba074 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.321805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404b50-9100-4513-93ba-04bb38eba074 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.324476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 181/364] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:57.325297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404b50-9100-4513-93ba-04bb38eba074 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.331344 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe18fce-6884-452e-95d7-9dc7745395fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:57.333191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe18fce-6884-452e-95d7-9dc7745395fa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:57.340263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.462659 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404b50-9100-4513-93ba-04bb38eba074 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.464979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 184/365] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:57.467109 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.467632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.468113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.498564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:57.499850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:57.555738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.556346 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.556627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.556900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.558573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:57.558905 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:57.561452 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:57.583462 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 182/366] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:02:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:57.585654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.641647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 185/367] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:57.642458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.684010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.726283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.768025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5aa69f-d14f-47a6-a06e-3533713c3661 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.802976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa3c9-fcd5-4fa4-94e5-e40d053113c7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.824584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.825748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.827958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.828386 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.829816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:57.831324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:57.833331 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 183/368] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:57 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:57.834160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:57.844117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.845079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.845587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.846192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.927902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:57.930272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:57.946415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ca55e-c4d5-4e4e-9705-559b04d62778 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:57.983288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:57.987695 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:57.988502 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:57.988777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:57.989052 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:57.998341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.004791 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:58.014694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:58.015592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:02:58.016388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 184/369] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:02:58.017030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.067742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 186/370] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:58.069238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.157975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0fcf8-d66b-42b6-b0f3-79976c23c2a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.205469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.206379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.206658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.206931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.211588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.213060 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.216080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 185/371] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:58.216888 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.218361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18b325-a9c6-48e5-a8c5-82650c879f90 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.249865 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.277841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.278597 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.278883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.279159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.279903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:58.280213 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.281594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.294107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 187/372] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:58.294107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.309203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.358112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ee9bc-7690-432b-8da2-72101ad3859d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.399745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.401442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.401987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.402404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.403773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.405409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.407335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 186/373] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:58.408316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.440951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf93d1-2fe2-47c0-a141-0d12b7c6b5af None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.489345 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.490031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.490293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.490572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.491396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=7215e66da950419a8b640eece36a4cb5) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:58.491703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.493409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.502361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 188/374] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=e11d9924ba394c088bd2aee20d352866 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:58.503252 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.538619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2939933-8a28-4cad-8941-ed6be8fcf755 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.573395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.584583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bffcf-f2ed-4781-9d72-d08eeee0cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.585689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bffcf-f2ed-4781-9d72-d08eeee0cef7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.586816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bffcf-f2ed-4781-9d72-d08eeee0cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.587343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bffcf-f2ed-4781-9d72-d08eeee0cef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.594523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.665370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd255b0-6f7b-4685-8206-8a30f8ce26dc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.686588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bffcf-f2ed-4781-9d72-d08eeee0cef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.688074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bffcf-f2ed-4781-9d72-d08eeee0cef7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.723176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.724580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.725269 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.725698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.727928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.731364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.734505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 189/375] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:58.746287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.848042 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 187/376] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:02:58.849401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe472f-ecb6-44ab-a0a0-722f8b5b32a2 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.849692 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe472f-ecb6-44ab-a0a0-722f8b5b32a2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.849995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe472f-ecb6-44ab-a0a0-722f8b5b32a2 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.851794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 188/377] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:02:58.853551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe472f-ecb6-44ab-a0a0-722f8b5b32a2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:58.887846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e871-1a22-4a9a-8486-3e31dc03f9bc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:58.902396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.905726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:58.929383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:58.930382 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.930856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.931315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.933501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=404a4769ebb543319b7a918411953668, scope.project.id=7215e66da950419a8b640eece36a4cb5) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:58.934027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:58.935661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cff08-4afa-4ed4-a682-eadde15f7360 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:58.946030 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 190/378] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=404a4769ebb543319b7a918411953668 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:58.947776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:58.948799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:58.949223 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:58.971036 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:02:58.972472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:02:59.018702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe472f-ecb6-44ab-a0a0-722f8b5b32a2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.055244 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 191/379] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:02:59.078398 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.079523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.079947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.080401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] PATH_INFO: `/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.081777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=80c3bd13a3974d42b6d3ecb6e6bc1a06)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:59.083731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:59.086153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 189/380] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:58 2022] GET /identity/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:59.090359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:59.092195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:59.218250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b5008-9dfd-4a4f-bf98-5da66a2e4b21 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.234372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:59.262975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.264174 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.264690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.265164 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.279540 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:02:59.290963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:02:59.292743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:02:59.293644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:02:59.296476 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 192/381] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:02:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:02:59.303210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:59.311138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac72be9-1019-40a7-850f-d493811c7bc9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.313507 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:59.358497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.359454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.359741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.360016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] PATH_INFO: `/v3/groups/3cc210e61a9e46f081b41d2410db3b78` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.366585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] RBAC: Authorizing `identity:get_group(group_id=3cc210e61a9e46f081b41d2410db3b78)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:59.368436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:59.370328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 190/382] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:02:59 2022] GET /identity/v3/groups/3cc210e61a9e46f081b41d2410db3b78 => generated 229 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:59.376029 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:59.421789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa50abf-14e9-49b8-b5e1-2c75b0e32c8b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.467260 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.468364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.468927 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.469400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.470494 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:59.471004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:59.472618 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:59.482283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 193/383] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:59.489030 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:59.521938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a2f28-09ea-42e2-9bf6-501de84057fc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.559930 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:59.598906 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.599627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.599910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.600289 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.601142 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] RBAC: Adding query filter params (group.id=3cc210e61a9e46f081b41d2410db3b78, role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=80c3bd13a3974d42b6d3ecb6e6bc1a06) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:02:59.601453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:59.610010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:59.633953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 191/384] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:02:59 2022] GET /identity/v3/role_assignments?group.id=3cc210e61a9e46f081b41d2410db3b78&scope.project.id=80c3bd13a3974d42b6d3ecb6e6bc1a06&role.id=08b7b51186384e71b433ea9c52d3430e => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:02:59.671724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649c8ea-88af-4d51-bdec-688c0c45f1d6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.726976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.727778 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.728057 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.728331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.731398 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:59.732854 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:59.734833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 194/385] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:02:59 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:59.745949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:02:59.802302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:02:59.912030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40274d9b-317e-40d0-b83a-0702aeb950f4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:02:59.957120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778fd98-d1a3-4215-922a-3cca701738fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:02:59.958300 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fd98-d1a3-4215-922a-3cca701738fd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:02:59.959469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fd98-d1a3-4215-922a-3cca701738fd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:02:59.959751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fd98-d1a3-4215-922a-3cca701738fd None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:02:59.961426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778fd98-d1a3-4215-922a-3cca701738fd None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:02:59.962900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778fd98-d1a3-4215-922a-3cca701738fd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:02:59.966703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 192/386] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:02:59 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:02:59.976606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:00.145486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:00.149469 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1858350-e05c-49e8-b56c-ef0d0bb319a9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:00.199856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422906d-b6c8-44ec-9f14-6215f584f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:00.200919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422906d-b6c8-44ec-9f14-6215f584f924 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:00.201326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422906d-b6c8-44ec-9f14-6215f584f924 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:00.201606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422906d-b6c8-44ec-9f14-6215f584f924 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/groups/c39d51671b6543e391710304e17e4663/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:00.203706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422906d-b6c8-44ec-9f14-6215f584f924 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26, group_id=c39d51671b6543e391710304e17e4663, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:00.205253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422906d-b6c8-44ec-9f14-6215f584f924 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:00.230587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 195/387] 10.222.0.30 () {58 vars in 1442 bytes} [Tue May 24 09:02:59 2022] PUT /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/groups/c39d51671b6543e391710304e17e4663/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:03:00.287462 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8153-628f-4554-b61a-d9633bce654e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:00.287790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8153-628f-4554-b61a-d9633bce654e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:00.288029 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a8153-628f-4554-b61a-d9633bce654e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:00.289531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 193/388] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:00.296072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:00.296368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:00.296654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:00.317589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:00.318847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:00.409836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 196/389] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:00.449054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8153-628f-4554-b61a-d9633bce654e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:00.574913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:00.580062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a8153-628f-4554-b61a-d9633bce654e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:00.621637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:00.622489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:00.622770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:00.623044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:00.634471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:00.642878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:00.643768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:00.645257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 194/390] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:00.653205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:00.751201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:00.766507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d27fd-ff8e-496d-9727-0cd7f42e43dc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:00.815519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:00.816212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:00.816493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:00.816770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:00.817510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:00.817820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:00.819235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:00.837379 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 197/391] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:00.843553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:00.962282 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6f124-4dcc-4309-b83c-5f71f036d4da None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:01.001065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:01.002078 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:01.002308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:01.002587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:01.003812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:01.005278 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:01.007247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 195/392] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:00 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:01.013335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:01.152408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a14879-983b-4d74-8120-bff3a949e35b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:01.195752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815250ae-bc22-4004-b9a2-03166c893451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:01.197002 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815250ae-bc22-4004-b9a2-03166c893451 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:01.197487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815250ae-bc22-4004-b9a2-03166c893451 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:01.198293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815250ae-bc22-4004-b9a2-03166c893451 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:01.202627 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815250ae-bc22-4004-b9a2-03166c893451 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:01.204296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815250ae-bc22-4004-b9a2-03166c893451 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:01.206567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 198/393] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:01 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:01.211959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:01.252332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:01.353774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d1d08-8d86-4dcf-b6b1-feda2440c4a8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:01.396529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ab92a-eca6-4cee-9e01-bda372e641b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:01.397420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab92a-eca6-4cee-9e01-bda372e641b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:01.397703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab92a-eca6-4cee-9e01-bda372e641b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:01.398000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab92a-eca6-4cee-9e01-bda372e641b8 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/groups/c39d51671b6543e391710304e17e4663/roles/404a4769ebb543319b7a918411953668` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:01.400264 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ab92a-eca6-4cee-9e01-bda372e641b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26, group_id=c39d51671b6543e391710304e17e4663, role_id=404a4769ebb543319b7a918411953668)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:01.402367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ab92a-eca6-4cee-9e01-bda372e641b8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:01.423960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 196/394] 10.222.0.30 () {58 vars in 1442 bytes} [Tue May 24 09:03:01 2022] PUT /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26/groups/c39d51671b6543e391710304e17e4663/roles/404a4769ebb543319b7a918411953668 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:01.566138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2922a-b76a-4b4c-a5be-18ebb5df2ea9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:01.566784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2922a-b76a-4b4c-a5be-18ebb5df2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:01.567358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2922a-b76a-4b4c-a5be-18ebb5df2ea9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:01.569279 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 199/395] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:01.575288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:01.575584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:01.575857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:01.607196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:01.608500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:01.703345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 197/396] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:01.729811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2922a-b76a-4b4c-a5be-18ebb5df2ea9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:01.753746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:01.862670 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2922a-b76a-4b4c-a5be-18ebb5df2ea9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:01.902804 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:01.903610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:01.903898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:01.904167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:01.919135 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:01.927315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:01.928212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:03:01.929029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:01.930235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 200/397] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:01.935701 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:01.960866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:02.054871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90f43d-1243-4c8c-b540-ca888b58902c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:02.097656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:02.098359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.098639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.098922 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.099678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:02.099986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:02.101366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1ddc-aff3-440c-93b9-bc814f425b77 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:02.113899 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 198/398] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:03:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:02.119424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:02.193326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753da0-5e35-4b08-9441-d42de3dd82fe None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.193639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753da0-5e35-4b08-9441-d42de3dd82fe None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.193894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b753da0-5e35-4b08-9441-d42de3dd82fe None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.195429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 199/399] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:02.200882 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.201168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.201450 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.222491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:02.225789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:02.227985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:02.259202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3f28-df69-4766-b28e-e07c0fe359ba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:02.308906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:02.309813 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.310119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.310454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.312378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:02.313988 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:02.316010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 201/400] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:02 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:02.323447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:02.350306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 200/401] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:02.387200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:02.407260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:02.432775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9812-3d47-41ff-a4c5-611d3fcf9b4d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:02.469562 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:02.470829 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.471347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.471836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.473231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:02.474899 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:02.482285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 202/402] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:02 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:02.484596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:02.502296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:02.552575 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c31a26-7358-426d-bb31-cc82a20c1e77 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:02.595307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47301d3-4c99-43d9-b5d0-54794a375b03 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:02.622716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:02.623474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.623754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.624025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.633632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:02.634847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.635425 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.635900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5/groups/c39d51671b6543e391710304e17e4663/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.638249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] RBAC: Authorizing `identity:create_grant(project_id=7215e66da950419a8b640eece36a4cb5, group_id=c39d51671b6543e391710304e17e4663, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:02.639993 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:02.641454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:02.658656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:02.659607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:02.661058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 201/403] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:02.666554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 203/404] 10.222.0.30 () {58 vars in 1442 bytes} [Tue May 24 09:03:02 2022] PUT /identity/v3/projects/7215e66da950419a8b640eece36a4cb5/groups/c39d51671b6543e391710304e17e4663/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:03:02.671128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:02.778309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:02.814567 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560e05b-31a6-4aba-9f7a-f5f24337fff6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:02.856116 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:02.856813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:02.857097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:02.857376 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:02.858175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:02.858486 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:02.859896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:02.876861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 202/405] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:02.882317 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.023310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:03.064553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53362070-e48d-41b6-9974-bec43be19051 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:03.120840 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e8e89-1610-4b9c-adbb-bbad4b60ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:03.121719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8e89-1610-4b9c-adbb-bbad4b60ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.122026 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8e89-1610-4b9c-adbb-bbad4b60ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.122308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8e89-1610-4b9c-adbb-bbad4b60ea58 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.123514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8e89-1610-4b9c-adbb-bbad4b60ea58 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:03.124960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8e89-1610-4b9c-adbb-bbad4b60ea58 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:03.126938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 204/406] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:02 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:03.131934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.156872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c6547-6a5c-44b9-aae3-1df8b5c22003 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.157191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c6547-6a5c-44b9-aae3-1df8b5c22003 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.157434 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c6547-6a5c-44b9-aae3-1df8b5c22003 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.159221 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 205/407] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:03.169823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.170148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.170806 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.199704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:03.200912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:03.314755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138079-0057-49e9-97a7-d234e0eddc82 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:03.318351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 206/408] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:03.350754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:03.357828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:03.358717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.359001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.359549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.360429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.373368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:03.374877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:03.376706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 203/409] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:03 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:03.383072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.508405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:03.527965 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e399f-1375-4dd4-9421-36e48a0aeca2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:03.568858 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8ab90-be3a-404b-8c25-1fa6fa325be5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:03.597295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1acf6-7bd7-40ad-bcea-7f93074200bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:03.599847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1acf6-7bd7-40ad-bcea-7f93074200bd None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.601071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1acf6-7bd7-40ad-bcea-7f93074200bd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.601572 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1acf6-7bd7-40ad-bcea-7f93074200bd None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5/groups/c39d51671b6543e391710304e17e4663/roles/404a4769ebb543319b7a918411953668` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.606110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1acf6-7bd7-40ad-bcea-7f93074200bd None admin] RBAC: Authorizing `identity:create_grant(project_id=7215e66da950419a8b640eece36a4cb5, group_id=c39d51671b6543e391710304e17e4663, role_id=404a4769ebb543319b7a918411953668)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:03.607839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1acf6-7bd7-40ad-bcea-7f93074200bd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:03.615937 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:03.616731 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.617018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.617272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.624976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 204/410] 10.222.0.30 () {58 vars in 1442 bytes} [Tue May 24 09:03:03 2022] PUT /identity/v3/projects/7215e66da950419a8b640eece36a4cb5/groups/c39d51671b6543e391710304e17e4663/roles/404a4769ebb543319b7a918411953668 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:03.626845 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e721-5e2a-4d10-a159-5a069fc0baf7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.627427 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e721-5e2a-4d10-a159-5a069fc0baf7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.627958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e721-5e2a-4d10-a159-5a069fc0baf7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.629672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 205/411] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:03.641822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.642477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.642981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.650270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:03.662341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:03.663909 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:03.664998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:03.665867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:03.667847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 207/412] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:03.679817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.737450 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:03.755668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 206/413] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:03.776303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.890571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c19aec-d5f4-419b-a6a3-dabbf0ac6799 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:03.928961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:03.930122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.930607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.931122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.939993 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bd22f-c26b-4519-8122-a11f9a0988c7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:03.944725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:03.953263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:03.954211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:03:03.955000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:03.957512 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 207/414] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:03.963658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:03.974281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:03.981449 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:03.982198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:03.982512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:03.983017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:03.983591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:03.983913 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:03.985301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:03.997073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 208/415] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:04.003075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.023416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:04.078963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a761-c697-413b-a749-a4d90e706594 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.113810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.114972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.115529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.116005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.116983 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:04.117616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:04.119283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:04.133720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 208/416] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:04.143814 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.202539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc86d6b-9646-4616-b8b6-34f72f81b980 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.258079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.259307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.259808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.262197 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] PATH_INFO: `/v3/groups/3cc210e61a9e46f081b41d2410db3b78` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.263853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] RBAC: Authorizing `identity:get_group(group_id=3cc210e61a9e46f081b41d2410db3b78)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:04.267476 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:04.270546 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 209/417] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/groups/3cc210e61a9e46f081b41d2410db3b78 => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:04.276544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.343463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c256e-3de1-4305-ade8-0f49a0596a3b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.359234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:04.381331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:04.384129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c96f25-ad88-4f8a-baea-7935ca1d7397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.385025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c96f25-ad88-4f8a-baea-7935ca1d7397 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.385891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c96f25-ad88-4f8a-baea-7935ca1d7397 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.386511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c96f25-ad88-4f8a-baea-7935ca1d7397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.436386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d54bc-0f91-480e-97f8-02d7c64046c7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.466335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c96f25-ad88-4f8a-baea-7935ca1d7397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:04.468141 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c96f25-ad88-4f8a-baea-7935ca1d7397 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:04.480906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3525c-d9d4-4df0-8d41-fc228331308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.483224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3525c-d9d4-4df0-8d41-fc228331308e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.483403 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3525c-d9d4-4df0-8d41-fc228331308e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.483645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3525c-d9d4-4df0-8d41-fc228331308e None admin] PATH_INFO: `/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.485154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3525c-d9d4-4df0-8d41-fc228331308e None admin] RBAC: Authorizing `identity:get_project(project_id=80c3bd13a3974d42b6d3ecb6e6bc1a06)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:04.487101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3525c-d9d4-4df0-8d41-fc228331308e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:04.490289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 210/418] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:04.492160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb43a1-d38c-4c0d-929b-21fe5210e536 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.492681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb43a1-d38c-4c0d-929b-21fe5210e536 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.493163 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb43a1-d38c-4c0d-929b-21fe5210e536 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.495107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 211/419] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:04.499179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb43a1-d38c-4c0d-929b-21fe5210e536 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.602341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 209/420] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:04.603730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.604720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.605070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.622420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:04.623835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:04.625002 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb43a1-d38c-4c0d-929b-21fe5210e536 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.631606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:04.659523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:04.667793 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.669069 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.669560 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.670119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] PATH_INFO: `/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06/groups/3cc210e61a9e46f081b41d2410db3b78/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.672795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=80c3bd13a3974d42b6d3ecb6e6bc1a06, group_id=3cc210e61a9e46f081b41d2410db3b78, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:04.674632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:04.690913 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 212/421] 10.222.0.30 () {58 vars in 1442 bytes} [Tue May 24 09:03:04 2022] PUT /identity/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06/groups/3cc210e61a9e46f081b41d2410db3b78/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:04.692264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.702657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 210/422] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:04.728629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.813755 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86234094-e7d0-48f5-9ae2-735b2f325d57 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.844066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78c767-04a9-4805-a3d0-a7dea794caff None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:04.853724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.855320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.855833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.856323 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.857882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:04.859752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:04.861973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 213/423] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:04.873922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.883994 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:04.885155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:04.891087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:04.891087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:04.899049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:04.908751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:04.909735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:04.910570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:04.914216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 211/424] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:04.916603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:04.927281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:04.991978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.038764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7767-3759-42fa-b1f8-679b2c19caef None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.040661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a41982-7b79-42d5-9a9f-d575a4cc38e4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.074961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.075835 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.076231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.076515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.077712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.079348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.079491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.080071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.080360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.080637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.081312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 214/425] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:05.081495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:05.081778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.083276 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.086941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.096786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 212/426] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:05.099223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.168238 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.195981 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c9308-f4a5-4f6c-8b13-d09265aa937b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.212517 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c052fa-21ad-4c79-9d4f-d36877cef650 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.222190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.232531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.233279 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.233636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.234016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.234918 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:05.235299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.236837 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc723-d824-4410-82dc-687e8fea0b26 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.243801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 215/427] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=e11d9924ba394c088bd2aee20d352866 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:05.251634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3582452-371b-497d-9aef-1df2c65e6b90 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.251998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3582452-371b-497d-9aef-1df2c65e6b90 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.252437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3582452-371b-497d-9aef-1df2c65e6b90 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.253721 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.254505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 216/428] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:05.254718 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.255172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.255558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.260823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.261327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.261683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.292677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:05.293898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:05.335611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.337224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.391401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 217/429] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:05.408844 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.422982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.461655 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 213/430] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:03:05.463440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.575655 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972c3fe-fad6-4480-b238-655eac8cda4f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.614817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da5af2-afa5-47e5-89e6-7071ca25600f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.620601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.621468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.621749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.622057 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] PATH_INFO: `/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.623268 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] RBAC: Authorizing `identity:get_project(project_id=dc47a2c4bfdf4c94b146b1fd1bc37a26)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.624721 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.629998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 214/431] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/projects/dc47a2c4bfdf4c94b146b1fd1bc37a26 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:05.632693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.641448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.671168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.673346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.674453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.674959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.675444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.698257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:05.706142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:05.707028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:03:05.707820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:05.714175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 218/432] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:05.716858 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.776580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3dfed-bea0-43f2-9411-388972e0c517 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.824622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.825494 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.825829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.826097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.828022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.829467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.831416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 215/433] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:05.837122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.840886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65ecee-7598-41bb-8fb3-5b9f13bd9b1c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:05.879089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:05.880111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:05.880635 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:05.881109 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:05.882081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:05.882625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:05.884288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:05.893838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 219/434] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:05.899451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:05.951613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.973283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:05.976912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356158f9-106e-4616-bbc7-cf28b1dcc283 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.017275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2e2b2-2ad3-441a-846d-42a14007270c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.019138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.019345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.020000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.020000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.020851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=404a4769ebb543319b7a918411953668, scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:06.021186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:06.022773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:06.029823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 216/435] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=dc47a2c4bfdf4c94b146b1fd1bc37a26&role.id=404a4769ebb543319b7a918411953668 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:06.068881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.069554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.069839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.070144 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.176190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:06.177692 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:06.231229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:06.302984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 220/436] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:06.309390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:06.427288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf84812-2663-417c-bee5-7585824bca17 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.462961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee017bc-a0e1-4104-9006-b27c7b7606bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.464697 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee017bc-a0e1-4104-9006-b27c7b7606bc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.465152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee017bc-a0e1-4104-9006-b27c7b7606bc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.465578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee017bc-a0e1-4104-9006-b27c7b7606bc None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.466958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee017bc-a0e1-4104-9006-b27c7b7606bc None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:06.468543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee017bc-a0e1-4104-9006-b27c7b7606bc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:06.474519 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 217/437] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:06 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:06.477900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:06.507731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1bc5-d5ac-4647-843b-39c3432d10bf None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.508047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1bc5-d5ac-4647-843b-39c3432d10bf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.508306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de1bc5-d5ac-4647-843b-39c3432d10bf None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.510070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 218/438] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:06.516596 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.516886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.517169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.539078 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:06.540263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:06.572415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:06.609174 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de1d6-da40-453d-9ef6-a65d8e11dd3a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.634534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 219/439] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:06.651404 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.652258 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.652538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.652809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.654013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:06.655457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:06.657324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 221/440] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:06 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:06.658239 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:06.663722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:06.676724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:06.767498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64417d-0e05-4849-aae5-f3c16f681e78 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.773937 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8419b5-ee5e-498e-b491-b055ad4965b6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.812136 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.812947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.813233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.813509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.814908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.815571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.815855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.816137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.816969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=e11d9924ba394c088bd2aee20d352866, scope.project.id=7215e66da950419a8b640eece36a4cb5) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:06.817282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:06.818751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:06.825131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:06.825833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 222/441] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:03:06 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=e11d9924ba394c088bd2aee20d352866 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:06.833897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:06.834917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:06.835708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:06.838308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 220/442] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:06.841119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:06.925716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:06.955286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9438-933f-4cd0-a141-60e86daaec15 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:06.991716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:06.992409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:06.992693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:06.992972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:06.993734 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:06.994087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:06.996287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698b9c4-fd76-407e-b51c-ba16c964cdd4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:07.009662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 223/443] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:07.010886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.038754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.133066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e70ad4-8ba4-4b81-aa2c-7b427667fc74 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.170486 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.171545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.172290 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.172578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.243083 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:07.245147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:07.268907 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.287015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08c61-ee7e-48b4-a16e-9be373e5a3df None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.287499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08c61-ee7e-48b4-a16e-9be373e5a3df None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.287588 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08c61-ee7e-48b4-a16e-9be373e5a3df None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.288982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 224/444] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:07.293832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.294159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.294446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.312031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:07.313233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:07.346300 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 221/445] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:07.351760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.380591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 225/446] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:07.403880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.450135 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b80c-ad90-4abb-97dd-09848168c583 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.469928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.472613 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.484997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.485851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.486166 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.486442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] PATH_INFO: `/v3/projects/7215e66da950419a8b640eece36a4cb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.487621 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] RBAC: Authorizing `identity:get_project(project_id=7215e66da950419a8b640eece36a4cb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:07.489050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:07.490909 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 222/447] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/projects/7215e66da950419a8b640eece36a4cb5 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:07.496281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.505660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79640-001b-46a7-b699-5ab2b0f22c1c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.542716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.543434 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.543714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.543989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.554331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:07.562071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:07.562949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:07.563739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 226/448] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:07.569011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.594173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638090d-dda9-4578-9c05-21c63f222175 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.628901 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.629749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.630063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.630339 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] PATH_INFO: `/v3/groups/c39d51671b6543e391710304e17e4663` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.631506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] RBAC: Authorizing `identity:get_group(group_id=c39d51671b6543e391710304e17e4663)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:07.632940 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:07.634566 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 223/449] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/groups/c39d51671b6543e391710304e17e4663 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:07.640725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.667278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343962b-e68c-4d0d-8b0f-7714c189f6f9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.692374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.697077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.703093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.703802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.704069 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.704354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.705110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:07.705420 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:07.706836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:07.715705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 227/450] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:07.721181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:07.740396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e4db-dab4-463d-aa0b-e60559684c5d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.773550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.774241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.774523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.774798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.776166 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] RBAC: Adding query filter params (group.id=c39d51671b6543e391710304e17e4663, role.id=404a4769ebb543319b7a918411953668, scope.project.id=7215e66da950419a8b640eece36a4cb5) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:07.776494 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:07.777926 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:07.783608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 224/451] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/role_assignments?group.id=c39d51671b6543e391710304e17e4663&scope.project.id=7215e66da950419a8b640eece36a4cb5&role.id=404a4769ebb543319b7a918411953668 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:07.831126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a67075-731c-4463-b574-45148d91a476 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:07.867331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:07.867990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:07.868274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:07.868554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:07.927472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:07.941666 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:07.943177 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:08.044808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 228/452] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:03:08.050496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:08.154969 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1bd37-2e36-4426-8980-bb05fd0ec186 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:08.177244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:08.189368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:08.190264 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:08.190551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:08.190828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] PATH_INFO: `/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:08.191999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] RBAC: Authorizing `identity:get_project(project_id=80c3bd13a3974d42b6d3ecb6e6bc1a06)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:08.193454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:08.195171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 225/453] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:03:08 2022] GET /identity/v3/projects/80c3bd13a3974d42b6d3ecb6e6bc1a06 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:08.201280 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:08.286401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:08.299049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaebd9-d476-44ba-bf43-ed6bbfb07ff9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:08.334372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb4be-d6b2-47b8-aeed-15c2d37e0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:08.335208 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb4be-d6b2-47b8-aeed-15c2d37e0b08 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:08.335514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb4be-d6b2-47b8-aeed-15c2d37e0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:08.335790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb4be-d6b2-47b8-aeed-15c2d37e0b08 None admin] PATH_INFO: `/v3/groups/3cc210e61a9e46f081b41d2410db3b78` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:08.336947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb4be-d6b2-47b8-aeed-15c2d37e0b08 None admin] RBAC: Authorizing `identity:get_group(group_id=3cc210e61a9e46f081b41d2410db3b78)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:08.338662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb4be-d6b2-47b8-aeed-15c2d37e0b08 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:08.340276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 229/454] 10.222.0.30 () {56 vars in 1180 bytes} [Tue May 24 09:03:08 2022] GET /identity/v3/groups/3cc210e61a9e46f081b41d2410db3b78 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:08.346130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:08.443367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e760e-652e-4cee-a046-e315fee6209b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:08.475252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:08.475894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:08.476178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:08.476452 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:08.477271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] RBAC: Adding query filter params (group.id=3cc210e61a9e46f081b41d2410db3b78, role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=80c3bd13a3974d42b6d3ecb6e6bc1a06) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:08.477584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:08.479555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d66db-903b-4eec-9c69-3456eeafb0c5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:08.485240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 226/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue May 24 09:03:08 2022] GET /identity/v3/role_assignments?group.id=3cc210e61a9e46f081b41d2410db3b78&scope.project.id=80c3bd13a3974d42b6d3ecb6e6bc1a06&role.id=08b7b51186384e71b433ea9c52d3430e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:11.243179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22877-5908-4327-be33-8b471980217d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.244381 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22877-5908-4327-be33-8b471980217d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.244883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22877-5908-4327-be33-8b471980217d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.246893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 230/456] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:11.253236 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d2d1-e2df-47e1-aa11-be650210ba6e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.254227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d2d1-e2df-47e1-aa11-be650210ba6e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.254734 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76d2d1-e2df-47e1-aa11-be650210ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.282975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2f76d2d1-e2df-47e1-aa11-be650210ba6e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:11.284529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2f76d2d1-e2df-47e1-aa11-be650210ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:11.353501 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:11.375711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 227/457] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:11.423721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22877-5908-4327-be33-8b471980217d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:11.454480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0646c-1ea8-41f4-bc24-280b66421153 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.455113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0646c-1ea8-41f4-bc24-280b66421153 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.455591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0646c-1ea8-41f4-bc24-280b66421153 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.457406 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 228/458] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:11.463525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.463810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.464090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.498527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:11.499775 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:11.612546 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22877-5908-4327-be33-8b471980217d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:11.652763 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 229/459] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:11.672240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:11.673354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.673840 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.674443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.677977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:11.691031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:11.692792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:11.725283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:11.726418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:11.727466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:11.727466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:11.727466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:11.727466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:11.735504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 231/460] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:11.741963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:11.765145 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:11.831163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff373e-69ef-43b3-913b-69c204d4f814 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:11.850547 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:11.879582 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:11.880997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.881432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.881889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.896419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:11.897521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e72ecc-8b42-4dee-8ed9-88e49eed819a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:11.898332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4bf61b18-a6ab-47a9-bff3-2a621ddb1b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:11.924488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:11.925559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:11.926623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:11.926623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:11.926623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:11.926623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:11.929215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 230/461] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:11.930792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6b49-0138-41aa-8255-5fec84b928e4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.931214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6b49-0138-41aa-8255-5fec84b928e4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.931644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6b49-0138-41aa-8255-5fec84b928e4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.933190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 231/462] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:11.935351 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b9964-49de-4955-a032-d13db17f2c25 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.936228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b9964-49de-4955-a032-d13db17f2c25 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.936658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b9964-49de-4955-a032-d13db17f2c25 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.938765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 232/463] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:11.939720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b9964-49de-4955-a032-d13db17f2c25 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:11.948857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:11.949520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.949798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.950107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.950833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:11.951137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:11.952512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c541be-2f64-467e-a76c-aa0da8fbedaf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:11.965363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 232/464] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:11.970972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842721-68dc-4eb8-ab36-6c514ae25a93 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:11.971269 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842721-68dc-4eb8-ab36-6c514ae25a93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:11.971552 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842721-68dc-4eb8-ab36-6c514ae25a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:11.988735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-69842721-68dc-4eb8-ab36-6c514ae25a93 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:11.989918 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69842721-68dc-4eb8-ab36-6c514ae25a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:12.052301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b9964-49de-4955-a032-d13db17f2c25 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.059390 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:12.070223 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 233/465] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:12.072358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.072821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.073371 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.089020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.090050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.090496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.090778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.091514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:12.091826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.093223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.095799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:12.097008 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:12.111795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 233/466] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:12.112724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.144253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:12.179253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 234/467] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:12.180421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.225326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0682d-0389-4f56-b306-3e894fb92c00 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.263119 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.263783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.264071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.264345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.265058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.266572 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.290175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 234/468] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:03:12 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:12.291299 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.313705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0b90-325d-4f67-8c67-e53e088e5a9c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.352755 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:12.364677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.366245 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.366761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.367571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.385542 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.388737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.401611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:12.418032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:12.418974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:12.419822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:12.419822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:12.419822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:12.419822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:12.423125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 235/469] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:12.424409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.434645 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd34ab-5bf2-4843-b3f9-8f7e213c4dc1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.474372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.475334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.475764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.476275 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.477160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.479280 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.510297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 235/470] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:03:12 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:12.511004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.568730 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3291e-a821-44d8-a6ac-1f9c23df2662 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.622048 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.623222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.624163 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.624662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.638053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.639591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.656119 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997e7f-590f-490c-bb41-50aaf310c746 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-215e12bc-4284-47f9-8819-65d734737263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:12.661295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:12.662219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:12.663583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:12.663583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:12.663583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:12.663583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:12.663583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 236/471] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:12.664551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f159-4d6c-4a72-8b34-abb7efaddd93 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.664551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f159-4d6c-4a72-8b34-abb7efaddd93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.664869 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f159-4d6c-4a72-8b34-abb7efaddd93 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.667226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 237/472] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:12.672463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f159-4d6c-4a72-8b34-abb7efaddd93 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.705086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.705780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.706097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.706491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.707233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:12.707553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.708963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12192e-bfbd-4323-ab11-5578d558dbd6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.711960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:12.719762 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:12.726253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 236/473] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:12.727388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.727682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.727962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.747086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:12.748311 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:12.805166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f159-4d6c-4a72-8b34-abb7efaddd93 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.841961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 237/474] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:12.843463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.849783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:12.850536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:12.850821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:12.851098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:12.851897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:12.852207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:12.854275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:12.867091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 238/475] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:12.872645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:12.980515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61596953-6f67-4bdd-a0e3-d4ed74700a59 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:12.994664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:13.006631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8eff1-135a-458a-81dd-a64be24d00dc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:13.009503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:13.020861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:13.021773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:13.022097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:13.022377 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:13.023263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:13.025656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:13.050423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:13.051247 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:13.051604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:13.051997 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:13.052791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:13.053457 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 238/476] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:03:12 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:13.054415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:13.054530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:13.081894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 239/477] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:03:12 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:03:13.213700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77ad95-df01-45fe-92fd-8c178faaa6f3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:13.256568 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:13.257252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:13.257539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:13.257818 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:13.258631 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:13.260127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:13.267989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.sql.core [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 09:03:13.267989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 24 09:03:13.267989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [parameters: {'id': '4cd414170b4b458aa1f4fdf0e9fa7ba5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 24 09:03:13.267989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80387) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() May 24 09:03:13.287508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return ref.to_dict() May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:03:13.288428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application yield resource May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.rollback() May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.force_reraise() May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise self.value May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application session.commit() May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 09:03:13.289308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._prepare_impl() May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.flush() May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._flush(objects) May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application compat.raise_( May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application flush_context.execute() May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rec.execute(self) May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 09:03:13.290186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application c = connection._execute_20( May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:03:13.291741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:03:13.292553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [parameters: {'id': '4cd414170b4b458aa1f4fdf0e9fa7ba5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:13.293336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 24 09:03:13.298503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:13.299334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 239/478] 10.222.0.30 () {60 vars in 1131 bytes} [Tue May 24 09:03:13 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:13.302989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:13.425176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30f10-1012-4285-92e0-ca3a542ae559 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:13.468019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5d4b8-6655-41c3-8ceb-a323f963217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:13.469296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d4b8-6655-41c3-8ceb-a323f963217a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:13.469779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d4b8-6655-41c3-8ceb-a323f963217a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:13.470302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d4b8-6655-41c3-8ceb-a323f963217a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:13.483439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5d4b8-6655-41c3-8ceb-a323f963217a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-55e5d4b8-6655-41c3-8ceb-a323f963217a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:13.491839 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:13.492726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:03:13.493551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:13.495448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 240/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:13.503508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:13.561531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:13.618483 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3e7f3-093e-4281-963f-2e8140c8f223 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:13.662624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:13.663294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:13.663578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:13.663857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:13.664607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:13.664917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:13.666941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a2b0-f5c9-4c3c-bb6a-1c4245a2fe29 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:13.682436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 240/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:15.264741 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f180ee-1cf2-4fc5-99bb-2084900b8a1e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.265296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f180ee-1cf2-4fc5-99bb-2084900b8a1e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.265296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f180ee-1cf2-4fc5-99bb-2084900b8a1e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.266727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857403-3248-48a1-aa6b-bb588134a111 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.267122 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 241/481] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:15.267613 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857403-3248-48a1-aa6b-bb588134a111 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.268124 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857403-3248-48a1-aa6b-bb588134a111 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.269703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 241/482] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:15.271848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.272134 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.272411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.275817 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.276344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.276820 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.290397 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:15.292651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:15.294980 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:15.302885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:15.305291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:15.419076 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 242/483] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:15.427810 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 242/484] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:15.444871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:15.470169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:15.518846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:15.634066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac5ce5-db35-4402-a375-0424db7d1064 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:15.650901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254fa54-f061-4b08-ad8b-fcc615d8e646 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:15.701190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33395d86-e497-45b6-b2ea-e06efb33907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:15.702021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395d86-e497-45b6-b2ea-e06efb33907f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.702306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395d86-e497-45b6-b2ea-e06efb33907f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.702583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395d86-e497-45b6-b2ea-e06efb33907f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.722902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd733ec-9173-402c-ba21-b52607e3827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:15.723218 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33395d86-e497-45b6-b2ea-e06efb33907f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:15.723714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd733ec-9173-402c-ba21-b52607e3827e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.723995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd733ec-9173-402c-ba21-b52607e3827e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.724270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd733ec-9173-402c-ba21-b52607e3827e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-33395d86-e497-45b6-b2ea-e06efb33907f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:15.732495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:15.733347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:15.734197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:15.734787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 243/485] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:15.735522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd733ec-9173-402c-ba21-b52607e3827e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:15.735807 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5bb52-6f20-4bcf-b2ff-bb9f4e7db7de None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.736097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5bb52-6f20-4bcf-b2ff-bb9f4e7db7de None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.736886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5bb52-6f20-4bcf-b2ff-bb9f4e7db7de None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.737856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 244/486] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:15.741683 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5bb52-6f20-4bcf-b2ff-bb9f4e7db7de None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:15.743252 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1cd733ec-9173-402c-ba21-b52607e3827e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:15.746190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:15.747085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:15.747870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 243/487] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:15.749184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.749184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.749184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.766954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:15.768142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:15.840711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 244/488] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:15.841786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:15.875843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:15.891656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5bb52-6f20-4bcf-b2ff-bb9f4e7db7de None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:15.928499 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:15.929530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.930044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.930516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.931517 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:15.932111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:15.933987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:15.942980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 245/489] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:15.944123 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:15.950063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0d538-4828-4c08-be18-5369ad3791de None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:15.981283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:15.991291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:15.992275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:15.992784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:15.993203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:15.994258 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:15.994721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:15.996335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.005768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 245/490] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:16.006860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.055822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc77b5-c3aa-46d0-a74b-29bfa5a44308 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.090721 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.091649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.092245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.092245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.103195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:16.111504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.112402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:16.113206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:16.117544 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 246/491] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.118342 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93425028-1bcf-48ab-87fd-eda664ee6e95 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.118455 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.150892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.156256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.157257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.157687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.158352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.170004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.171696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:16.190553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.191421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.192940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:16.192940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:16.192940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:16.192940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:16.192940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 246/492] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.192940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.238106 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.240716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2050486-1466-409a-ba0c-efe326206e95 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.279831 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.280733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.281017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.281305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.292674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.294411 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.302453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe0cdd-bd0b-4ab0-96e7-d01669554dc4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-bef627c5-4ce9-4e36-b1fa-51f4f8761560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:16.313482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.314357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.315201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:16.315201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:16.315201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:16.315201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:16.315201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 247/493] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.315977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2144c-3502-4d4a-9129-bf08bdf1f735 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.316140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2144c-3502-4d4a-9129-bf08bdf1f735 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.316377 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2144c-3502-4d4a-9129-bf08bdf1f735 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.321830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 248/494] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:16.321830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2144c-3502-4d4a-9129-bf08bdf1f735 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.350022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.350709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.350990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.351266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.352025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:16.352330 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.353841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.363335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 247/495] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:16.364004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.413094 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.440893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2144c-3502-4d4a-9129-bf08bdf1f735 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.475237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.475905 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.476195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.476477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.477202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:16.477517 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.479465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd50a6f-36ca-46cc-8426-dca83eec582a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.480129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555864a9-3d5f-4d25-a0d2-4eb1fd093709 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.483243 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.492610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 249/496] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:16.494121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.494417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.494698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.511550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:16.512739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:16.523399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.524415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.524704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.524977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.526109 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:16.526426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.527799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.545286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 248/497] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:16.545286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.587649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 250/498] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:16.589066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.647070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9d4c3-521f-4ab6-93b1-3f47c8da9971 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.651646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.681811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.682671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.683115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.683395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.690433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e18ef-6193-42ce-8a2e-b78705b4b30c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.693372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.694850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:16.716548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.717474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.718402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:16.718402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:16.718402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:16.718402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:16.718402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 249/499] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.719275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.729099 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.730021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.730306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.730585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.737720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.738370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.739214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6aaf3731-1d79-4a20-92e4-2208df71e9cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:16.755852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.756980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:16.758419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 251/500] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.761034 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911623-2c49-4365-a616-66c715d37f48 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.761322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911623-2c49-4365-a616-66c715d37f48 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.761597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911623-2c49-4365-a616-66c715d37f48 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.763019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 252/501] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:16.763776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911623-2c49-4365-a616-66c715d37f48 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.821070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627960c-ddfe-45fe-aaed-320147d56ad4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.855114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.855830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.856125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.856407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.863411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:16.864861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:16.868307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911623-2c49-4365-a616-66c715d37f48 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:16.881115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.882073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:16.882958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 250/502] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.883584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.897416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.909365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:16.910204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:16.910491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:16.910767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:16.920778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:16.928650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:16.929539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:16.930368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 253/503] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:16.931012 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:16.968239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:16.991136 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54d04-badb-40a9-bc0f-83bb9919c7ef None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.025838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.026432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.026721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.027003 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.027730 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:17.028041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.029442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794a45-48e9-4fb2-b90b-8855fe13a84b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.032858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f990ee3-97eb-4854-aeae-d74903b4ac35 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.040573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 251/504] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:17.041811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.042206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.042494 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.059140 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:17.060337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:17.067529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.068195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.068480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.068776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.069589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:17.069896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.071359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.107675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 254/505] 10.222.0.30 () {56 vars in 1137 bytes} [Tue May 24 09:03:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:17.108432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.129863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 252/506] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:17.130605 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.155850 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.198230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.212216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8227c3e-7b3d-40f7-8610-9bc9e61277bc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.232745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85539c11-f30c-481b-81dc-1c7ec5fdeb7a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.246458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.247124 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.247409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.247685 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.248518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:17.248827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.250286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.266799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.266949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 255/507] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:17.267468 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.267675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.267774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.268105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.268849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:17.269173 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.270578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.278914 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 253/508] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:17.279714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.363834 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.367030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8aed-0538-44fc-a1be-e7486de47cf7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.381676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97055e1-6354-4d1f-97d1-9fe8d9cb4171 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.402525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.403318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.403600 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.403877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.407871 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.410988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.412501 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.417690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.418506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.419009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.419368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:17.430583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:17.432243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 256/509] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:17.433255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.489885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.491364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.534149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700b4c3-23c1-4655-b7cd-27678ef1a52c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.569557 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.570372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.570651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.570919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.581169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.582682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.590105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 254/510] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:17.590944 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:17.605430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:17.606487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:17.607368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:17.607368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:17.607368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:17.607368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:17.607368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 257/511] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:17.607751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.622739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.624070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.699822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99025e-050d-49da-9d3d-9556d9d57015 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.711361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91b836-7a10-4a0d-8de5-a8c3024b660e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.734605 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.735247 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.735532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.735810 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.744671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.745460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.745749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.746060 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.756519 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.758071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:17.775526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:17.776543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:17.777401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:17.777401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:17.777401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:17.777401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:17.777401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 258/512] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:17.777678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.811571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.813030 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.840645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.843290 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:17.881421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e738-0364-4224-9301-baf0e3a544e8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:17.913714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 255/513] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:17.914534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:17.915429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:17.916225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:17.916577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:17.916896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:17.918802 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:17.918802 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:17.920038 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:17.942310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 259/514] 10.222.0.30 () {56 vars in 1139 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:17.942310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.018250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b925bc-14c2-420f-95c0-bb2a1c0ab4d9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.040468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057be1-d944-4fd9-b3e2-efc630a2873a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.044655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.053295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.054117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.054406 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.054683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.063704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.065447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.066986 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.075924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.076577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.076862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.077138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.077856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:18.078196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.079556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:18.084933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:18.085732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:18.086623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:18.086623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:18.086623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:18.086623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:18.086623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 256/515] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:18.087160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.096451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 260/516] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:18.096451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.187605 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef513a2-c7f7-4cbd-a6fc-248ecefaa189 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.191256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d4f4-c9d0-4e52-9508-fcbc8f668114 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.222237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.222896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.223181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.223519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.224225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:18.224532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.224754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.225537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.225811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.225926 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.226116 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.237155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 257/517] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:18.237415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.238061 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.238910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:18.256227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:18.257186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:18.263297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:18.263297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:18.263297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:18.263297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:18.263297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 261/518] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:18.263297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.280244 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.294712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.348086 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a6de-036a-4114-9a3a-0c5f6e6197b7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.363155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3260859-be7e-47c1-887b-29d29513ccbc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.386443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.387087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.387370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.387645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.397123 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.397785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.398102 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.398383 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.399105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:18.399417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.400967 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.412862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 262/519] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:18.413663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.458483 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.459863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.499236 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.505023 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.512491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7746f-ccfe-4409-93d7-ac1761318368 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.546705 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.547643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.547931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.548213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.548918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.550393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.558545 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 258/520] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:18.559369 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.571016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 263/521] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:03:18 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:18.571826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.679427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7afcc5-e114-4b29-9580-de45352db480 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.694823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090ed40-c794-405b-8430-fa2c61cab3d5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.718225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.719323 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.719795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.720070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.727965 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.729634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.732609 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.737120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.737809 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.738153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.738619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.739468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:18.739783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.741204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:18.748158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:18.749217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:03:18.750372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:18.752310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 259/522] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:18.752310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.760589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 264/523] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:18.761974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.774765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:18.874071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf80b8-9372-4405-a5ee-076061cac773 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.881286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd441b5a-1f62-4b9c-b00d-f9345f3ad70d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:18.910682 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.911473 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.911755 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.912287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.919321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.920765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.923886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:18.924681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:18.924972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:18.925247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:18.938823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:18.939591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:18.940428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:18.941563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:18.942354 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:18.942423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 260/524] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:18.942423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:18.959874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:18.960823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:18.961684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:18.961684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:18.961684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:18.961684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:18.961684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 265/525] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:18.962648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.011855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.037894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.058661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e63306-4ea3-4b98-82dd-3c8f229facd9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.084510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a2b4-8365-4f30-8705-2495865dcb27 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.095443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.096110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.096414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.096689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.097516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:19.097821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.099301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.128427 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.129504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.129957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.130377 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.138826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.139034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 261/526] 10.222.0.30 () {56 vars in 1137 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:19.139947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.140913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:19.159707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:19.160761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:19.161790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:19.167963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 266/527] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:19.167963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.252999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c048b-8650-4b90-a269-f4881532527b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.267145 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119107-8343-4225-a470-536d80fa3e18 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.271672 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.290051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.290766 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.291146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.291856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.292659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:19.292972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.294462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.294572 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.308839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.309789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.310764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.311479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.312432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:19.312919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.313304 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 262/528] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:19.314152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.314906 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.334247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 267/529] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:19.335101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.429207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdce0d-353d-4b61-91de-7ce8f1e587d0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.445800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d8db3-e2fd-4335-b27d-99320ebf2848 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.466044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.466757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.467040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.467749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.482008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.482669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.482951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.483225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.484012 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:19.484316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.485752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.511030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 268/530] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:19.511030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.516809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.542866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.544261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.557724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.623504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a9a8-a9f8-4258-9f33-264355e42f6a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.659954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 263/531] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:19.659954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.669179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.669839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.670155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.670423 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.671421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=7c8d51e0bff14ada928537dafdb67654) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:19.671613 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.673281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.689944 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 269/532] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/role_assignments?user.id=7c8d51e0bff14ada928537dafdb67654&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:19.689944 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.761597 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.799685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0a237-cae3-4c62-9c01-5c06b3f2228c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.836836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5399-a9ee-4a4f-8a4b-dad0d3ef81ae None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:19.842603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.843780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.844283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.844756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:19.845700 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.855736 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.857715 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:19.875148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:19.876105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:19.876998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:19.877441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:19.877538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:19.877769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:19.878077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:19.878915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=10ba53ef4d604f33aa31e50d053f3641) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:19.879228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:19.879676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 264/533] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:19.880598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:19.880717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:19.887678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 270/534] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/role_assignments?user.id=10ba53ef4d604f33aa31e50d053f3641&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:19.888562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:20.063166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0dfd9-f42f-4e8a-a730-f71e1ec80ba0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:20.084244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18aed7-acef-4361-b901-51c20920f890 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:20.105411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:20.106510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:20.107152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:20.108263 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:20.118188 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:20.125007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:20.126893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:20.146160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:20.146823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:20.147103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:20.147378 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:20.148157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:20.148464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:20.149886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:20.154704 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:20.155538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:20.156448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:20.156448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:20.156448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:20.156448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:20.162367 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 265/535] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:20.169588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 271/536] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:20.170571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:20.177122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:20.238457 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:20.331586 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b03c1-90a9-4538-80cd-e4e23fbdfc4b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:20.368145 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:20.369229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:20.369846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:20.371095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:20.372772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=061ff7358d4e45cdaaa15196aef8c4a2) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:20.373430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:20.375482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:20.385479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2185-303d-4488-9cc2-45c7338802af None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:20.387817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 266/537] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:20 2022] GET /identity/v3/role_assignments?user.id=061ff7358d4e45cdaaa15196aef8c4a2&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:20.442821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:20.443884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:20.444357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:20.444815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:20.445753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:20.446274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:20.448826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:20.463586 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 272/538] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:20.469159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:20.559514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:20.627961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bfc91-ff75-4ec4-aa52-8d564e2eae87 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:20.669023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:20.669819 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:20.670137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:20.670416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:20.677682 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:20.679170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:20.694582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:20.695446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:20.696278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 267/539] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:20.701467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:20.851771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:20.862884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aed6f-a8e5-428b-b71a-9c749121afb2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:20.915166 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:20.915937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:20.916314 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:20.916599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:20.917398 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:20.917709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:20.919196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b93c1c-6126-4dc8-b678-0e577ec736b9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:20.941369 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 273/540] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:20.946798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:21.079482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe202d-26bc-40d4-9a27-62793e615c6c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:21.094631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:21.111246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba2110-9073-4cc8-b474-813c91c8d72d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:21.111533 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba2110-9073-4cc8-b474-813c91c8d72d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:21.111808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba2110-9073-4cc8-b474-813c91c8d72d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:21.113415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 274/541] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:21.118613 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:21.118977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:21.119268 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:21.124449 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:21.125114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:21.125403 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:21.125684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:21.126550 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=cccb32a47f7d4144b224d9fcc99091e3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:21.126866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:21.128331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:21.138425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:21.140056 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:21.142347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 268/542] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:20 2022] GET /identity/v3/role_assignments?user.id=cccb32a47f7d4144b224d9fcc99091e3&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:21.217833 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 275/543] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:21.242663 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:21.373184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1289497-ff68-45d0-97bd-d2772b748c1b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:21.420101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:21.420911 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:21.421199 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:21.421480 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:21.433652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:21.441411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:21.442351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:21.443139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 269/544] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:21.450234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:21.572019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:21.597560 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a696d-9e5e-4960-8c55-e5c30ff9596d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:21.649709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:21.650951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:21.651219 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:21.651497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:21.652249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:21.652554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:21.653959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:21.662246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 276/545] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:21.667837 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:21.736095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:21.820419 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ff64-233e-4c3a-baa3-7b0d1924d89b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:21.861105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:21.861834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:21.862152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:21.862437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:21.877308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:21.878804 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:21.900267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:21.901521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:21.902487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:21.902487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:21.902487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:21.902487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:21.902487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 270/546] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:21.907393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:22.079333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665732e-f869-4ce0-92fa-c5683fddfc1b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:22.114864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:22.115452 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.115730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.116003 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.116725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:22.117026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:22.118434 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:22.133382 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 277/547] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:22.143024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:22.272542 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:22.283030 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aae33-febf-44d9-b918-0bbe1c5266d4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:22.326381 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:22.327185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.327468 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.327748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.335516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:22.337026 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-110803a5-81fd-441a-a013-17810a3a6eb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:22.351657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:22.355116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:22.357504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 271/548] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:22.366139 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:22.369077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:22.437055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb817c2-2ebf-47fa-9600-d5b2a1ae2f9d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.437416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb817c2-2ebf-47fa-9600-d5b2a1ae2f9d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.437610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb817c2-2ebf-47fa-9600-d5b2a1ae2f9d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.439267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 272/549] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:22.444567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.446004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.446688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.483072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:22.484309 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:22.529332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3665d55-2fec-4f19-b0da-161b233d1637 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:22.595813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:22.596494 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.596774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.597046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.597886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:22.598215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:22.599651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:22.607899 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 273/550] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 24 09:03:22.628465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 278/551] 10.222.0.30 () {56 vars in 1135 bytes} [Tue May 24 09:03:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:22.633539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:22.645238 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:22.726405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:22.754264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:22.770582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eff5c-14ea-48f7-902b-3a302175888f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:22.771114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c026087-042d-4236-a3d8-e2567856e4a4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:22.809729 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dc12-4f7c-41c1-be76-b9956d347433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:22.810429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dc12-4f7c-41c1-be76-b9956d347433 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.810809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dc12-4f7c-41c1-be76-b9956d347433 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.811088 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dc12-4f7c-41c1-be76-b9956d347433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.817192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc702634-dc52-44fe-8bf5-f6c2d613321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:22.818022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc702634-dc52-44fe-8bf5-f6c2d613321f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.818308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc702634-dc52-44fe-8bf5-f6c2d613321f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.818586 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc702634-dc52-44fe-8bf5-f6c2d613321f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.832518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc702634-dc52-44fe-8bf5-f6c2d613321f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-bc702634-dc52-44fe-8bf5-f6c2d613321f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:22.843356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:22.844394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:22.845585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 279/552] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:22.846582 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340513-2acb-427f-9e15-805a250142bd None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:22.846582 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340513-2acb-427f-9e15-805a250142bd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:22.846582 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc340513-2acb-427f-9e15-805a250142bd None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:22.848724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 280/553] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:22.850204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc340513-2acb-427f-9e15-805a250142bd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:22.900186 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1dc12-4f7c-41c1-be76-b9956d347433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:22.901870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1dc12-4f7c-41c1-be76-b9956d347433 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:22.962352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc340513-2acb-427f-9e15-805a250142bd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:22.984644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:22.985536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.002439 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.003336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.003773 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.004188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.005149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:23.005280 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 274/554] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:23.005894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.006778 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.007074 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.007359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.008051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.018479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 281/555] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:23.019549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.029007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:23.030221 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:23.102475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 275/556] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:23.103792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.136095 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c04a7f-1b75-4523-8508-8206451538a8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.173680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.174880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.175385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.175852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.189394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.191277 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.206674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a5c7d-5a6c-47c3-90e2-88204f756ca2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:23.209420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:23.210542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:23.211622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:23.211622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:23.211622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:23.211622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:23.213758 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 282/557] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:23.214824 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.222282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.247370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.248366 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.248768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.249139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.254130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.264271 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.266022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:23.285251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:23.286791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:23.287649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:23.287649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:23.287649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:23.287649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:23.287649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 276/558] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:23.287649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.329227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197e2d2-aa10-4704-a417-65266cf8a5ca None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.367963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5496160-6fc4-4afa-aedc-487bafe48a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.369816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496160-6fc4-4afa-aedc-487bafe48a45 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.369816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496160-6fc4-4afa-aedc-487bafe48a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.370050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496160-6fc4-4afa-aedc-487bafe48a45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.381309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5496160-6fc4-4afa-aedc-487bafe48a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a5496160-6fc4-4afa-aedc-487bafe48a45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:23.389785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:23.390706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:23.391594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 283/559] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:23.392755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43d19-72c6-426b-bb95-88aaf4699bf6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.392860 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43d19-72c6-426b-bb95-88aaf4699bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.393102 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43d19-72c6-426b-bb95-88aaf4699bf6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.394535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 284/560] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:23.395075 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43d19-72c6-426b-bb95-88aaf4699bf6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.399724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e055c9-efc0-42cc-a9c0-8ca4e20a8077 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.434628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.435215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.435505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.435786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.436515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:23.436825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.438239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.451772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 277/561] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:23.455650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.479983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.502475 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.512800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43d19-72c6-426b-bb95-88aaf4699bf6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.548348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.549019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.549318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.549599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.550376 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:23.550673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.552052 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb76029-65cf-4f23-ba13-66e18e1171bb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.561504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e884-e3bb-435b-ba16-c6a13f2b960a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.563974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 285/562] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:23.567282 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.567642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.567987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.589153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:23.590400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:23.599842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.600518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.600802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.601080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.601818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:23.602154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.604019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.617511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 278/563] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:23.617511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.665128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 286/564] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:23.666451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.719428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.736637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684cbff-99ca-4de2-b6be-5874a631aa7f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.773481 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.773705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.774420 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.774706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.775508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.783468 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.785090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.792643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af73af-ee8f-4d80-ad56-189ac4fb0597 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:23.806392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:23.807336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:23.808265 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:23.810097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 279/565] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:23.811051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.834249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.835323 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.835610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.835892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.844366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.845822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:23.860786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:23.861765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:23.862760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 287/566] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:23.863357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:23.918599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cf41f-d8b1-4c28-8d29-258d05c6f1cf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.953463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:23.954287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:23.954574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:23.954856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:23.964986 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:23.966474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:23.966821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05f7d3-b49a-469c-8e18-234701bc50d3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:23.969018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:23.985328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:23.986410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:23.987471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:23.987471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:23.987471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:23.987471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:23.987471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 280/567] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:23.987471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.005140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5582e-99f7-4f6d-8419-720ed15a239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.005969 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5582e-99f7-4f6d-8419-720ed15a239f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.006255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5582e-99f7-4f6d-8419-720ed15a239f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.006535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5582e-99f7-4f6d-8419-720ed15a239f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.016770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5582e-99f7-4f6d-8419-720ed15a239f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a9a5582e-99f7-4f6d-8419-720ed15a239f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:24.024674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:24.026320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:24.027304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 288/568] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:24.028128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aead8b-d8b3-4a2b-939d-52c022919496 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.028128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aead8b-d8b3-4a2b-939d-52c022919496 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.028128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aead8b-d8b3-4a2b-939d-52c022919496 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.029409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 289/569] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:24.030146 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aead8b-d8b3-4a2b-939d-52c022919496 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.033791 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.094903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c738d17-a630-47e9-a83b-4e77ede4a31a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.129002 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.129664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.129974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.130255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.131046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:24.131357 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.132805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.134356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aead8b-d8b3-4a2b-939d-52c022919496 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.144262 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 281/570] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:24.145053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.168937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.169598 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.169877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.170179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.171008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:24.171313 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.173009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.189566 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 290/571] 10.222.0.30 () {56 vars in 1137 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:24.190392 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.208843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.253650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.254442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032937a-3877-4d58-8cc0-c1ebf9cda7f3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.286757 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.287471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.287753 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.288056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.288775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:24.289084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.290498 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73a692-2389-4230-8e85-92f1eddf1cc0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.293347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6244e82-42b3-4753-a129-09a87c7bbb0e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.302969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 282/572] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:24.304242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.304533 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.304813 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.321412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:24.322832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:24.327686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.328356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.328644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.328926 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.329668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:24.330009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.331380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.339736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 291/573] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:24.340525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.394525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 283/574] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:24.396737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.443736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8805f-b20f-4c4b-b519-484e93afd9a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.450500 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.467298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.480209 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.480865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.481160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.481439 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.482305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=cda4a224028a47f9afef8b443eb59a4c) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:24.482622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.484057 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.489418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 292/575] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/role_assignments?user.id=cda4a224028a47f9afef8b443eb59a4c&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:24.490222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.507090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1bb2c-d759-429d-aea4-b9c9e9c1c6de None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.547614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.548442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.548733 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.549009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.562450 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.563921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:24.584141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:24.585116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:24.586044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:24.586044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:24.586044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:24.586044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:24.586044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 284/576] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:24.586329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.612602 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254f63-422d-4098-a3f5-4637cf354db5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.653399 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.654241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.654524 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.654808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.663603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.665064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:24.680207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:24.681671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:24.682707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 293/577] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:24.684015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.705943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.710333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f2d5f-04b1-47dd-bbce-481161c8ff8c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.742490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.750457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.751246 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.751524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.751798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.764365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.765741 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:24.784077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:24.785583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:24.786658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:24.786658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:24.786658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:24.786658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:24.792270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 285/578] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:24.793268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.814562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6e4f7-5329-4f42-98a8-b6e8984b4208 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.850360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.851156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.851441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.851716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.862565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:24.870885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:24.871786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 294/579] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:24.877422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.905952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb5ae0-0734-4d83-b9cc-01e45af1293e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.943117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:24.943814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:24.944080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:24.944352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:24.945075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:24.945493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:24.947561 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:24.964118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 286/580] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:24.964118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:24.979168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:24.984353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270688a-1978-4482-ba4c-9b8a94c9fced None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:24.994551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.028922 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.029492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.029776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.030082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.030917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.031450 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.032652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.052556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 295/581] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.053458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.080317 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2863067-a469-420a-b220-d56179ecd63d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.115010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.115683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.115970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.116251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.116970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.117279 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.119222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.131180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 287/582] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.132002 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.164608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382f1d1-8043-485e-aafd-088717f24e82 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.203963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.204642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.204924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.205200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.205983 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.206296 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.208103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.211058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.221420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 296/583] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.221420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.249357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.252451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4ef3-f28f-4dc6-a037-d6c203154086 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.290179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.291496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.291777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.292051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.299342 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.300790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:25.315424 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:25.316333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:25.317235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 288/584] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:25.317744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.333511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ac41-f853-419a-9122-47de35abf246 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.370455 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.371535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.372020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.372478 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.383606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.385107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:25.406508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:25.407428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:25.408343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:25.408343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:25.408343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:25.408343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:25.408564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 297/585] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:25.409806 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.428464 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31514a70-afe4-47ea-8e48-c05aa410e7c4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.457161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.464827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.465627 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.465932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.466212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.474055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.475487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:25.489564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:25.490530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:25.491445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 289/586] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:25.492034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.503383 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.527317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e13dc-3bf3-47e8-b745-2fd62eecbe08 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.563059 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.564162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.564644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.565118 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.577371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.579242 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:25.598511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:25.599465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:25.600318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:25.600318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:25.600318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:25.600318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:25.600318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 298/587] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:25.600593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.609893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6754-8586-4b2c-9a7c-8978ae349fa8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.647679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.648372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.648625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.648903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.649675 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.650591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.652499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.669718 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 290/588] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.669718 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.717842 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b250-ce0b-4e2a-8901-e72ef59e0413 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.726442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.749678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.755428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.756092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.756733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.756733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.757363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.757670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.759072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.771015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 299/589] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.771594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.788309 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5332800-147c-492b-8c92-933dd5c47993 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.831200 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.831788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.832071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.832345 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.833165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.833471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.834922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.852253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 291/590] 10.222.0.30 () {56 vars in 1139 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.853048 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.881794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a4b8-845b-41c6-bd24-2cc2003a1b4a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.918141 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:25.918805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:25.919092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:25.919552 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:25.920079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:25.920381 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:25.922044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:25.935202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 300/591] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:25.936098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:25.966545 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c310-bc57-4ed7-a9ee-c8bf87f56d3f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:25.976053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:25.992053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.007226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.008110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.008386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.008655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/7c8d51e0bff14ada928537dafdb67654/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.024237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=7c8d51e0bff14ada928537dafdb67654, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.026281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.039633 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 292/592] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:25 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/7c8d51e0bff14ada928537dafdb67654/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:26.040787 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.058689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeec1fc-efb6-4a22-95c4-bafdf87a0cbe None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.103980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.104857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.105263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.105799 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.114420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.116172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:26.133223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:26.134294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:26.136208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:26.140612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 301/593] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:26.141588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.182385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c185bd5-520b-4a82-b17d-9b71a171e487 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.231046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.231857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.232146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.232425 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.245201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.246727 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:26.266481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:26.268027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:26.269168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:26.269168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:26.269168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:26.269168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:26.269168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 293/594] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:26.269168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.275920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eba885-a8b9-4f1c-824b-141f748564e3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.287156 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.292157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.318564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.319370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.319657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.319936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.329163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.330651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:26.349868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:26.351048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 302/595] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:26.352169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.407899 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1481a9a-f0c5-4dd6-b157-c7cf0d31537c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.444628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.445298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.445573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.445854 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.446676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:26.447211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.448676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.461195 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 294/596] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:26.462179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.471676 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78baef9-ca86-480d-8717-74783f50c529 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.512460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.513152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.513436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.513834 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.514651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:26.515051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.516432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.531733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 303/597] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:26.532715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.540406 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.574665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.576900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3cf4b-6402-4a45-b3e1-f16339e7dd3e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.613730 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.614447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.614732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.615011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.615848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:26.616159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.617594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.640778 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 295/598] 10.222.0.30 () {56 vars in 1137 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:26.640778 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.665402 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627989c-fe37-44e3-b7ea-5fe1f4380221 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.705665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.706914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.707364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.707864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/10ba53ef4d604f33aa31e50d053f3641/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.726232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=10ba53ef4d604f33aa31e50d053f3641, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.728639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.741066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75a251-4c6b-4d90-8350-1558653b3041 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.743053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 304/599] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:26 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/10ba53ef4d604f33aa31e50d053f3641/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:26.745740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.773217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.788554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.789376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.789652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.789958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.799085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.800568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4c4dab22-c2db-4340-b867-2c641962f277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:26.817421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:26.818554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:26.819599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:26.821970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 296/600] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:26.823792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65602083-1cc2-4834-af25-0751fb7dc012 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.824231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65602083-1cc2-4834-af25-0751fb7dc012 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.824710 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65602083-1cc2-4834-af25-0751fb7dc012 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.826407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 297/601] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:26.827251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65602083-1cc2-4834-af25-0751fb7dc012 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:26.867711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:26.893570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7901ad-afdd-421f-b479-78d37c9f4c76 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:26.936382 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:26.937541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.938038 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.938507 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.952076 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:26.953848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-68e0ac75-ad3c-41f7-8052-0343ef8e1e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:26.974510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:26.975611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:26.976713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:26.976713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:26.976713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:26.976713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:26.980489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 305/602] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:26.980489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:26.980489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:26.985163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:26.989032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65602083-1cc2-4834-af25-0751fb7dc012 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.002879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:27.004199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:27.029821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.030947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.031235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.031513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.032584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:27.032897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.035096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.051193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 298/603] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:27.051981 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.093208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 306/604] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:27.094219 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.127808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:27.189579 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0364da-8d9b-4796-b3c4-5195298d0713 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.196080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:27.239067 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6590-5456-4b64-b2bf-9a92d2a6bedf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.239685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.240435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.240745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.241318 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.243187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:27.243507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.245185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.271479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 299/605] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:27.272486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.285270 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.286678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.286968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.287249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/061ff7358d4e45cdaaa15196aef8c4a2/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.309136 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=061ff7358d4e45cdaaa15196aef8c4a2, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.310941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.332413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 307/606] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:27 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/061ff7358d4e45cdaaa15196aef8c4a2/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:27.333271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.389973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca027c9-da31-4cc0-a1d4-a671d74db181 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.400529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:27.433932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.437931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.437931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.437931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.452187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:27.462959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:27.464566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:27.466070 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:27.473936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 300/607] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:27.473936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.477292 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88eb81d-9c55-4e96-9b37-f34c8442fd54 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.494459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:27.520756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.521764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.522232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.522587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.531763 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.533700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:27.555972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:27.557651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:27.559606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 308/608] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:27.567231 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.622947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17015e2-5239-4c5a-b8a1-589f7340d951 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.662946 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.663670 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.663958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.664236 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.664986 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:27.665294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.667153 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.676489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 301/609] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:27.682932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.720176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:27.757979 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326388f-945c-4e44-ac67-3f715cf73069 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.801496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.802196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.802481 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.802918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.803722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:27.804031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.805474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.820410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 309/610] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:27.828923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:27.853512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27ba7-62eb-4bf4-b1d0-56f6c29cc45e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:27.895713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:27.919490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:27.920288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:27.920568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:27.920845 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:27.951870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:27.953341 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:27.990712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:27.991647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:27.992517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:27.992517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:27.992517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:27.992517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:27.995448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 302/611] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:28.000537 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:28.043459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f741c2-4eb1-4c83-b781-3f54689f4b43 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:28.098336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:28.099233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.099513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.099789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/cccb32a47f7d4144b224d9fcc99091e3/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.115711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=cccb32a47f7d4144b224d9fcc99091e3, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:28.117155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:28.136890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 310/612] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:27 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/cccb32a47f7d4144b224d9fcc99091e3/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:28.151805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:28.174445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e01ff-d60a-4e92-afb1-6ae7f675b5dc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:28.224987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:28.225663 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.226010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.226296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.227041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:28.227335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:28.229300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:28.250044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 303/613] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:28.255803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:28.375609 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:28.395590 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b88463-0011-4621-bd46-439f643b7ec1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:28.435722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:28.436519 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.436803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.437077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.444776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:28.446327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5cb75ffb-ccf4-496c-bf24-d5568f723178 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:28.461545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:28.462935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:28.463883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 311/614] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:28.470560 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:28.600190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda1b7-3803-461a-8794-e86fe45c0537 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:28.615771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14cb1-fd5a-4afc-a88b-8a6fe4d8e56b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.616428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14cb1-fd5a-4afc-a88b-8a6fe4d8e56b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.616933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14cb1-fd5a-4afc-a88b-8a6fe4d8e56b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.618968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 312/615] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:28.624561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.625108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.625611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.649949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:28.649949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:28.654287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:28.654972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.655254 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.655526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.656371 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:28.656673 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:28.658139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:28.690270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:28.701181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 304/616] 10.222.0.30 () {56 vars in 1135 bytes} [Tue May 24 09:03:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:28.705095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:28.808844 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 313/617] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:28.838716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683781f-e31a-48ac-be20-ebdfabcaf15f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:28.849887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:28.880297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:28.881014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:28.881289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:28.881563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:28.901566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:28.903184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:28.923870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:28.924841 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:28.925747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:28.925747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:28.925747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:28.925747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:28.925747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 305/618] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:28.931693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:28.998036 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.035923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.052917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec247b56-01f6-4ae3-b2de-008796d28123 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.093199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df05f57-a5ad-454c-94af-68f37747a5dd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.094426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.095262 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.095544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.095817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.097358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:29.097665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.099080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.121459 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 306/619] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:29.131099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.141258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.142097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.142378 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.142656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.154665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:29.163020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:29.163931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:29.164757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 314/620] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:29.170999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.270112 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb426e7-613b-424e-8ffb-e2cba7e8248b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.284191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.300090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ee41-d74f-4a6d-83de-1457df7399f2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.311553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.312809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.313294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.313770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.321410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.323800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.338287 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.339476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.339945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4041e140-49ee-49a8-972a-8e3465ef9907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:29.340321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:29.341196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:29.342141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:29.342679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.342679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:29.342679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.343612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7099f2-4ba2-441f-8aa1-3626aa7cbd4a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.345009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.345926 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 307/621] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:29.347331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457d6a-c218-4cdc-904b-ee18c8f8ac66 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.347814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457d6a-c218-4cdc-904b-ee18c8f8ac66 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.348233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457d6a-c218-4cdc-904b-ee18c8f8ac66 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.349849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 308/622] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:29.356396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457d6a-c218-4cdc-904b-ee18c8f8ac66 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.359054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 315/623] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:29.360521 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.361625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.361950 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.383353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:29.385532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:29.473378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457d6a-c218-4cdc-904b-ee18c8f8ac66 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.481930 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 316/624] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:29.481930 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.528659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.529397 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.529690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.530060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.530962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:29.531323 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.532800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.546831 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 309/625] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:29.552374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.588273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.606112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eda958-3bee-4dde-99df-9087bde84df9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.635183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.644331 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.645544 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.646064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.646561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.658177 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.660070 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.670340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd117bd-748a-4510-88ca-349ed055bc66 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:29.679005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:29.679929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:29.680838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:29.680838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:29.680838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:29.680838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:29.683660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 317/626] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:29.684679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.710511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.711246 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.711507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.711783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.725393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:29.735040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:29.736016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:29.736834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:29.741164 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 310/627] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:29.742226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.798241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12fb0-0bc5-4145-a3e9-73a95637a7f2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.841188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.842959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.843549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.844028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/cda4a224028a47f9afef8b443eb59a4c/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.858512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.860884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=cda4a224028a47f9afef8b443eb59a4c, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.862816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.871335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226b11-6828-426d-86c0-cf0eb2183805 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:29.878429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 318/628] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:29 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/cda4a224028a47f9afef8b443eb59a4c/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:29.879552 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:29.911243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:29.946884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:29.948230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:29.948516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:29.948793 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:29.949552 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:29.949860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:29.951783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:29.980372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 311/629] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:29.985698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.001840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f03e6-a640-41cf-835f-047f99a901d3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.039558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.041224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.041766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.042317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.043320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:30.043841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.045494 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.055726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 319/630] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:30.063615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.139097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fffa1-80d8-4ec9-9c89-bf51c5b4453c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.190111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.190936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.191219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.191495 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.203012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.204482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.210368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:30.223599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a3304-4bcc-438b-8d74-b135018dc22b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cd96e50a-a748-404d-9034-516bdaca17b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:30.225466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:30.226601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 09:03:30.227743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:30.228473 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 312/631] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:30.231511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88833766-85f9-47a4-a0dc-3fbb100caf39 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.231511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88833766-85f9-47a4-a0dc-3fbb100caf39 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.231511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88833766-85f9-47a4-a0dc-3fbb100caf39 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.231511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 313/632] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:30.233469 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88833766-85f9-47a4-a0dc-3fbb100caf39 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.250989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:30.271163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.272783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.273167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.273776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.288207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.289680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6f0e5127-7754-41b0-841b-c5db5595242a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:30.316071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:30.316998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:30.317880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:30.317880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:30.317880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:30.317880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:30.317880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 320/633] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:30.322104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.322104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.322104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.343471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:30.344939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:30.368166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88833766-85f9-47a4-a0dc-3fbb100caf39 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.408900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.409667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.409975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.410255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.411085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:30.411393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.413049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.420884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 321/634] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:30.422261 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.434215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 314/635] 10.222.0.30 () {56 vars in 1137 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:30.442959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.527281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:30.528429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:30.562822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a34ec8-23e9-4d54-9d9f-f1ee7247b361 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.571776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cea5a-2ee8-499c-9899-a773b2225bcc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.607036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.607975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.608264 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.608538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.609542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:30.609858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.611954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.615451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.616237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.616630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.616972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.625031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 322/636] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:30.625857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.702775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.704257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.768942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4603c-2b95-46d8-8aae-b96d81a63da8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.777892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:30.814679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:30.816271 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 315/637] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:30.822227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.825395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.826470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.826938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.827391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.840367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:30.848865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:30.850245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:30.851062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:30.853835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 323/638] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:30.855032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:30.929573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b79ce-daef-4271-9aa2-f5a25ec66b5a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.961959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469d925-2229-4d52-89ff-47497ac096f8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:30.965398 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:30.965884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.966114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.966386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.973683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:30.974930 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bc81e39d-1975-4d66-8c39-9616ce7a98d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:30.989780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:30.990851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:30.991805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 316/639] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:30.992413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d23c-990e-4b96-9cfe-8702cb8842fd None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:30.992413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d23c-990e-4b96-9cfe-8702cb8842fd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:30.993384 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d23c-990e-4b96-9cfe-8702cb8842fd None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:30.999044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 317/640] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:30.999161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d23c-990e-4b96-9cfe-8702cb8842fd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.006796 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.007598 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.007884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.008159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.018970 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.020413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.036131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:31.037603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:31.038864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:31.039786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:31.039786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:31.039786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:31.039786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:31.039786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 324/641] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:31.039786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.084531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.121321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d23c-990e-4b96-9cfe-8702cb8842fd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.143362 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821c6a-154a-444d-a7b2-1b9a6c68cd94 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.157610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.158303 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.158866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.158866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.159583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:31.159887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.161258 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a861-01f0-482f-8079-d0a3e0448ced None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.169940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 318/642] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:31.171172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.171809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.172205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.186422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.187093 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.187374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.187648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.188509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:31.188815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.189108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:31.190266 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.190511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:31.217137 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 325/643] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:31.217137 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.269931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 319/644] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:31.269931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.287725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.339549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abcc1a-f03c-486b-a80e-9f26a1c15506 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.341318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.371572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1403e-97a5-4e0d-ace6-39eb6670b6f8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.377416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.378111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.378397 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.378672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.379393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:31.379695 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.381059 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.392804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 326/645] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:31.393626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.415140 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.416506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.416788 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.417057 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.427770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.429212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:31.448073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:31.449032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:31.454881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:31.454881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:31.454881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:31.454881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:31.454881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 320/646] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:31.454881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.504854 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5d6a-f326-4c91-9099-27010ee05965 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.529686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.541755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.542440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.542730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.543005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.557018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd3112-851f-49d0-ba08-3bb76e91bb53 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.575504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.592458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.593257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.593545 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.593825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.605171 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:31.612902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:31.613833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:31.614703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 321/647] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:31.615446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.622591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.624059 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.724754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836a325-6ad6-430c-accf-adeda4c7a55e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.734222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 327/648] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:31.735375 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.766945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.767664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.767944 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.768220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.771201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.778038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.779656 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:31.795861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:31.797019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:31.797939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 322/649] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:31.798443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.807216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:31.853523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86b49-d272-4d57-92e5-cb3341abaae7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.896703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.897779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.898353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.898643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.899611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:31.900448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.902575 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.906500 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559811a-6136-46c5-8bc8-e3e861bbed20 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:31.922062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 328/650] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:31.922062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:31.943134 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:31.943809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:31.944096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:31.944377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:31.945124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:31.945433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:31.947046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:31.955869 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 323/651] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:31.956599 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.016480 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.045792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72550f7-0d4c-4179-b3d9-1382d526a589 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.071917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3410dde-d521-489a-9b0d-d96c0d2dfff1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.072658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.085931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.086860 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.087650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.087998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.099609 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.101158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.107137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.107828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.108121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.108400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.109210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:32.109525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.111049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:32.121100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:32.122113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:32.123167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:32.123167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:32.123167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:32.123167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:32.125190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 329/652] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:32.126293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.129954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 324/653] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:32.129954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.233066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319c655-6d2d-486d-a379-b24c9d8d5bcc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.238272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9196d6-3d7f-4240-95c1-3c2f80198052 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.251347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.270900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.271692 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.271973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.272250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.274829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.275703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.276058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.276404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.283268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.284279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.284760 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.285840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:32.301106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:32.302395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:03:32.303550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:32.304132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:32.304908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:32.311346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:32.311346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:32.311346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:32.311346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:32.311346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 325/655] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:32.311346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.312126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 330/655] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:32.312126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.344126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.407907 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83fffd-e86d-4151-acda-9c9a80467a4a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.411579 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544d4b-da96-4d99-9c45-f67f512a88d0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.442373 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.443025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.443314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.443590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.444308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:32.444614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.445291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.446016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.446120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.446340 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.447173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.448004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=7c8d51e0bff14ada928537dafdb67654) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:32.448307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.449734 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5431598-4af4-4915-b0e1-ad2757abdb43 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.455714 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 331/656] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/role_assignments?user.id=7c8d51e0bff14ada928537dafdb67654&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:32.456720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3518d0a-3552-4f2e-b6e1-b58eb945a725 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.457004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3518d0a-3552-4f2e-b6e1-b58eb945a725 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.457281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3518d0a-3552-4f2e-b6e1-b58eb945a725 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.458598 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 332/657] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:32.459298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3518d0a-3552-4f2e-b6e1-b58eb945a725 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.472700 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 326/658] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:32.474089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.511851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.579328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.585366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3518d0a-3552-4f2e-b6e1-b58eb945a725 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.596873 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2aa5a-e877-4fa1-a617-c87a44e8ec3e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.624194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.624871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.625156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.625456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.626330 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:32.626640 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.628104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249b988-43ba-4010-be49-2dbb573dcf6c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.634764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.635435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.635720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.635997 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.636735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:32.637043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.638482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.648748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 333/659] 10.222.0.30 () {56 vars in 1139 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:32.650393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.650733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.651030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.656431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 327/660] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:32.657118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.668886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:32.670122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:32.747131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 334/661] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:32.747982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.769238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.783642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e4a5a-9144-4e6e-8616-d3d9a01bb4ff None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.822639 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.823762 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.824249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.824518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.831376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.832745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.844580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:32.846584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:32.847457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:32.848338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:32.852427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 328/662] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:32.853146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:32.864138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383c54f-d335-49c3-ac87-051ca0eddb81 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.901640 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.902319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.902790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.902923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:32.958248 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6dbe5-2c01-46b9-aa80-9d86b046a57d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:32.974372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:32.975830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:32.993270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:32.994282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:32.994566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:32.994845 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.002653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.004100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:33.018856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:33.025185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 329/663] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:33.026290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.038875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.071975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.090682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 335/664] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:33.091858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.143791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798e80-2a72-434e-83db-57e695d92f24 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.180683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.182437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.182925 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.183369 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.194297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7378a80-0563-4901-92ba-0024b685dfab None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.194831 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:33.203193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:33.204299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:33.205299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:33.207493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 330/665] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:33.208525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.235478 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.236448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.236732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.237015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.237805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:33.238149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.239581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.251853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 336/666] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:33.252775 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.283745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.303757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.322635 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802be1-dce1-4faf-8c67-0f5ea91bacb9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.356530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.357438 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.357887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.358341 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.359312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:33.359765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.361336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.362339 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2d81-8db0-449c-92b8-6a40672438a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.385652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 331/667] 10.222.0.30 () {56 vars in 1137 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:33.386559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.401522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.402448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.402727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.402993 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.413717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.415216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:33.435360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:33.436420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:33.437469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:33.437469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:33.437469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:33.437469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:33.437469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 337/668] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:33.438936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.497337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5387e-5f19-4288-90ea-3ab33d583845 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.525537 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.535610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.536380 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.536549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.536827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.537570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:33.537882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.539324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.546417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.551144 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af2eab-75f9-402c-98eb-6fcc3c0a5888 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.553023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 332/669] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:33.553738 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.589149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.589804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.590137 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.590422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.591261 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=10ba53ef4d604f33aa31e50d053f3641) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:33.592121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.593006 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.599617 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 338/670] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/role_assignments?user.id=10ba53ef4d604f33aa31e50d053f3641&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:33.603136 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.676869 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e751-f66b-4ffa-8bb0-9a3d45ef9623 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.720657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.721480 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.721863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.722270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.738105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f066352-3fef-4a76-8e4a-5435ed7ca2da None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.783147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.784491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.784776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.785053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:33.785779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:33.786170 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.795170 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.797229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.814548 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 339/671] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:33.815512 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.819123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:33.821160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:33.847251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:33.947601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 333/672] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:33.947906 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fe0be-dcfc-47ba-9fd1-4f660cabfe13 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:33.948385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:33.993241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:33.994996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:33.995349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:33.996030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.010031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.012338 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:34.035766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:34.036953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:34.038068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:34.038068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:34.038068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:34.038068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:34.042456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 340/673] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:34.042908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.043348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.061445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e2c39-f6ac-4e4a-a0ec-ad579ba004ee None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.110357 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.111438 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.111728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.112009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.123079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.124548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.127938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:34.146073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:34.147155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:34.148274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:34.151742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 334/674] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:34.153468 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.160976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21b5d8-6659-4f93-98d2-e72b4b709e5c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.198845 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.199567 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.199855 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.200520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.214347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.216150 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:34.241436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:34.242437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:34.243827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:34.243827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:34.243827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:34.243827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:34.243827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 341/675] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:34.244400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.292602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa5a6f-d549-48d6-9cb6-032d69109c7b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.342487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.344175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.344646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.345131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.346326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:34.347287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.349450 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.367433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 335/676] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:34.367609 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8944c39-4cbc-463f-9183-2688e5eeda5e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.369253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.382472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.409143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.424810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.425782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.426306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.426766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.427843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:34.428333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.430149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.452007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 342/677] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:34.453298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.488882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af4ede-55ff-4a52-9b75-c76e2455a871 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.526201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.526979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.527334 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.527684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.528596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:34.528985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.530551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.543414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 336/678] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:34.544388 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.572556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a37b5-fe3b-45df-8f28-78a744121e82 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.610948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.612055 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.612588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.613045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.614457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.624748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.626841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:34.644506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:34.645522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:34.646529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:34.649500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 343/679] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:34.650880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.660821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfbdf-1948-4ac2-9f23-1b4a9a4ac965 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.697222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.698049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.698446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.698793 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.699684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=061ff7358d4e45cdaaa15196aef8c4a2) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:34.700281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.701576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.705983 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.708377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 337/680] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/role_assignments?user.id=061ff7358d4e45cdaaa15196aef8c4a2&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:34.709626 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.773615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69e077-1e25-4290-917c-dbfaf06ab8c3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.814997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.816206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.816699 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.817182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.826895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.829012 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.842392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715533-7dc5-4228-ae20-2ec8ba553f69 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:34.846418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:34.847437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:34.848334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:34.851024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 344/681] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:34.863075 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.914990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:34.926932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:34.928083 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.928584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.929886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.931920 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:34.932465 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:34.935105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bff480-c824-4961-9159-8c87fea751bd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:34.956576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 338/682] 10.222.0.30 () {56 vars in 1135 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:34.961832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b339-b4d0-4caf-be2e-0d4bcee61448 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:34.961832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b339-b4d0-4caf-be2e-0d4bcee61448 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:34.961832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b339-b4d0-4caf-be2e-0d4bcee61448 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:34.964489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 339/683] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:34.965315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b339-b4d0-4caf-be2e-0d4bcee61448 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:34.998755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6776289-875b-4061-9312-736db6a9f450 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.008160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:35.050164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.051695 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.052160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.052717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.053794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:35.054521 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.057687 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f5d3-60e3-4516-b01a-2f52c5e8178c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.074487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 345/684] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:35.076841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.077285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.077712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.089899 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b339-b4d0-4caf-be2e-0d4bcee61448 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.101065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:35.102418 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:35.135638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.136983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.137564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.138161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.178933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 346/685] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:35.180128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.219013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:35.234324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.236032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.286794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:35.294578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b63b90-2421-435b-9a2c-d6cd47495481 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.337001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.338047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.338425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.338788 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.341932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=cccb32a47f7d4144b224d9fcc99091e3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:35.341932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.341932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.352196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 347/686] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:35 2022] GET /identity/v3/role_assignments?user.id=cccb32a47f7d4144b224d9fcc99091e3&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:35.353893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.365159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 340/687] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:35.370270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.486227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:35.498268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4909a8-f23a-4864-9da8-e13612880454 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.539300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.540794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.541228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.541751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.553546 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.555062 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:35.575886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:35.576800 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:35.577679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:35.577679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:35.577679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:35.577679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:35.580054 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 341/688] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:35.580599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c19d3d-ad3e-415f-82fe-806a418e84ca None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.591068 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.621889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.622864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.623217 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.624040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.639130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.640614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:35.665054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:35.666549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:35.667460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:35.667460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:35.667460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:35.667460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:35.670661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 348/689] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:35.677928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.700584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:35.734852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa94f8-01d0-4bd8-9d54-a0c0ed9d4223 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.835246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c23e4-2914-44d4-981a-050d29cf1721 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:35.843165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.843852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.844136 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.844417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.845149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:35.845460 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.846943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.872903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 342/690] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:35.873131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:35.873703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:35.874115 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:35.874394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:35.875130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:35.875438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:35.876809 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:35.880780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.888549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:35.892929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 349/691] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:35.902324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:35.983227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:36.018803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767838c-0fbe-45e7-8343-9b3130380a4e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:36.063415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:36.064442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.064929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.065413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.066435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:36.068175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:36.115251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 350/692] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:03:35 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:36.122867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f642a-f12f-4770-bcce-0aa7853159bc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:36.161270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:36.162121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.162409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.162686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.171224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:36.172993 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5346b92f-73b7-42d1-974a-ad9fedf388c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:36.188953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:36.189953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:36.191391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 343/693] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:36.199096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:36.233777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eaffc-de0e-4e54-a3ae-86a5f84ae034 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.234191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eaffc-de0e-4e54-a3ae-86a5f84ae034 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.234469 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eaffc-de0e-4e54-a3ae-86a5f84ae034 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.236340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 344/694] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:36.241553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.241968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.242251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.284454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:36.285694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:36.351272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aae9-94f9-4fa1-8454-3599fb8532d9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:36.385202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:36.397701 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:36.399031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.400072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.400720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.401679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:36.402199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:36.404411 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:36.408010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:36.422243 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 345/695] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:03:36.424234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 351/696] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:36.429563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:36.450955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:36.548026 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641603-d2f5-45ee-9dd0-5b1964acf5b6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:36.562528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0b0f-f6f8-4a52-9235-79f89591550e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:36.587664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:36.588549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.588863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.589219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.590146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=cda4a224028a47f9afef8b443eb59a4c) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:36.590686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:36.592325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:36.599737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:36.600098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 346/697] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:36 2022] GET /identity/v3/role_assignments?user.id=cda4a224028a47f9afef8b443eb59a4c&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:36.601236 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.601780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.602300 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.616192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:36.625526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:36.626555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:36.627390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:36.630010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 352/698] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:36.637945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:36.758491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:36.825731 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce920-8ce6-4c52-8abb-42320cded79e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:36.869428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:36.870044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:36.870327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:36.870604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:36.871416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:36.871727 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:36.873150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:36.882363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 347/699] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:36.888456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:36.944858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:37.002466 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dc189-183f-4062-93a9-7f14fce4154e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:37.037868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:37.038784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.038954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.039232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.051296 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:37.052750 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:37.070530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:37.072082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:37.073108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:37.073108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:37.073108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:37.073108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:37.073812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 353/700] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:37.078633 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:37.188959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f4abe-73c6-40fa-8696-511c78f0b6b5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:37.210342 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:37.231611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:37.232278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.232558 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.232829 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.233556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:37.233860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:37.235251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:37.249256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 348/701] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:37.254615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:37.362674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:37.365939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28350c0-aac9-4dc2-bba4-880583e08891 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:37.402369 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:37.403173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.403459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.403739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.411698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:37.413159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a00df7b8-219a-45cc-a296-df8184fab756 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:37.428195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:37.429138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:37.430518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 354/702] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:03:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:37.435914 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:37.453137 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9c79-7378-40a6-b230-3b931d57e3c6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.453432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9c79-7378-40a6-b230-3b931d57e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.455212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c9c79-7378-40a6-b230-3b931d57e3c6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.456171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 355/703] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:37.460584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.460857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.461138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.490196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:37.494303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:37.599679 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 356/704] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:37.616215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79aeca-0c3b-4eef-b8f0-c5d25b8cef4f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:37.635778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:37.682735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:37.683418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.683702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.684038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.684888 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:37.685844 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:37.687548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:37.720151 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 349/705] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:03:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:37.727094 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:37.770516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:37.782298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298098b-d6a8-4169-88e1-3862a1a9e7e0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:37.804428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:37.850624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:37.851471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.851750 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.852021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:37.852720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:37.854128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:37.879881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:37.880977 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:37.881803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 357/706] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:37 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:37.884765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95940da5-889a-4ece-be21-7cdf85cd9dee None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:37.887117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:37.939168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:37.940262 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:37.940754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:37.941235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.076310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.077959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.093861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01146-f568-426e-9c9f-92929068d5d0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:38.150264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:38.183538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:38.184218 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.184503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.184779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.185495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] RBAC: Adding query filter params (name=network) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:38.185803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.191299 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.196075 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 358/707] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:03:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:38.201974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:38.209719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 350/708] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:38.215611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:38.250282 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:38.339729 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43a7c8-13fe-4e74-ba55-9f6755c83aea None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:38.368894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59d72-20f9-4393-9315-11200596ca28 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:38.376877 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:38.377759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.378091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.378365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.381496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:38.390851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.392300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4b3195e5-e37c-485f-b9e8-ce59d5fa7c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:38.411072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:38.412160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:38.413190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:38.413190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:38.413190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:38.413190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:38.417086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:38.417591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 351/709] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:38.418050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.418438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.418821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.419179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c73cf-63a6-4c1c-9248-210496e29fa5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.419472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c73cf-63a6-4c1c-9248-210496e29fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.419749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c73cf-63a6-4c1c-9248-210496e29fa5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.419856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:38.420274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.421822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 352/710] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:38.422685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c73cf-63a6-4c1c-9248-210496e29fa5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:38.426129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d3bb7-b67b-4275-bfc2-458ba6eb8fa5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.434226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 359/711] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:38.436143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.436443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.436728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.461134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:38.463273 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:38.554051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c73cf-63a6-4c1c-9248-210496e29fa5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:38.556309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 360/712] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:38.612229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:38.612835 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.613121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.613399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.614162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:38.614474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.615870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.625230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:38.636311 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 353/713] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:38.642589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:38.656262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:38.729968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:38.799257 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16402994-a413-4179-8b3c-09c536f25d7c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:38.806439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569d99-7f50-409d-a0c7-d22040cb12d3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:38.846617 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:38.847637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:38.848114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.848495 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:38.848781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.849064 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.849277 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:38.849976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:38.850850 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.853000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.856624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:38.862123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:38.877971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:38.878981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:38.879893 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 361/714] 10.222.0.30 () {56 vars in 1129 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:38.892844 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:38.895690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:38.896606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:38.897520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 354/715] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:38.904041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.024142 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:39.050652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fc2ff-a188-4bab-87d4-afbb41b96975 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.056046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316521-3a6c-4904-bd45-0dfee2d91f00 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.066457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:39.089357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.090258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.090614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.090964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.091862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:39.092241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:39.093703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8c163-407e-4acd-b4a1-2408902ead13 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:39.096749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.097576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.098033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.098452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.098844 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 362/716] 10.222.0.30 () {56 vars in 1124 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:39.100053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:39.100174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040ec46-9bc7-48b1-b07f-7824a6435a9a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.100416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040ec46-9bc7-48b1-b07f-7824a6435a9a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.100695 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040ec46-9bc7-48b1-b07f-7824a6435a9a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.101078 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:39.103297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615805-a3d0-4c69-a917-782dccc52921 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:39.106032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 363/717] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:39.106982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040ec46-9bc7-48b1-b07f-7824a6435a9a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.121934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 355/718] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:39.121934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.121934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.121934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.144685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:39.145786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:39.218938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040ec46-9bc7-48b1-b07f-7824a6435a9a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.256358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.257200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.257585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.258019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.259488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:39.259984 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:39.261529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:39.274284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 364/719] 10.222.0.30 () {56 vars in 1124 bytes} [Tue May 24 09:03:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:39.275591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.290836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:39.374129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 356/720] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:39.410947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.508183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755801c0-7b9d-4558-8c47-02c1fb2d01f2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.548635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.549302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.549585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.549861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.550740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=10ba53ef4d604f33aa31e50d053f3641) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:39.551055 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:39.552498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:39.560135 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 365/721] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:39 2022] GET /identity/v3/role_assignments?user.id=10ba53ef4d604f33aa31e50d053f3641&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:39.572185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:39.576827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6b27d-ce7e-4ccf-bb4e-7a7ed400d00c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.619752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a5ae-0178-42fd-a279-e338a3e40df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.620581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a5ae-0178-42fd-a279-e338a3e40df5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.620868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a5ae-0178-42fd-a279-e338a3e40df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.621148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a5ae-0178-42fd-a279-e338a3e40df5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.633701 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a5ae-0178-42fd-a279-e338a3e40df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7270a5ae-0178-42fd-a279-e338a3e40df5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:39.642285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:39.643287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:39.644105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 357/722] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:39.650055 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.663227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da551f-62c8-4ade-9892-de7c0b00800e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.663828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da551f-62c8-4ade-9892-de7c0b00800e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.664308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da551f-62c8-4ade-9892-de7c0b00800e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.666274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 358/723] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:39.672028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.672608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.673092 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.692124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:39.693660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:39.732549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:39.772618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d76a-cfe7-4606-b6a4-b1166ffc50c1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.793943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 359/724] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:39.821707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.836171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.836924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.837271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.837543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.838341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:39.838871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:39.840288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:39.861535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 366/725] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:39.866961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:39.930612 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:39.944314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36a17-b10a-4594-87c3-3c52e3d43650 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:39.982153 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:39.982954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:39.983233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:39.983505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:39.995043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:39.998547 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648fb83-8c37-49ee-8438-fd52c0df7702 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:40.002628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:40.003524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:40.004352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 360/726] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:40.014868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.037815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:40.046594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.047686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.048174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.048823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.060869 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.062681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:40.081597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:40.082595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:40.083473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:40.083473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:40.083473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:40.083473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:40.085703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 367/727] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:40.091657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.199210 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0939550-1ea2-4993-ae20-3178ae7acadb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.220960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2578f65-abf3-4282-8079-2fc94f063359 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.240009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.242455 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.243028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.244918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.245862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:40.247162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.250299 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.273135 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 368/728] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:40.279513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.285695 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.291819 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.292393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.292876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.293826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:40.294378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.295984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.312361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 361/729] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:40.318784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.342522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:40.343353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:40.408528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b4f-7b00-4876-8875-06e1e2c56919 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.445827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.447172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.447694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.448168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.456351 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.458087 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:40.473559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:40.474543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:40.475473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:40.478677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 369/730] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:40.490013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.519365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6bf1-55c1-41ec-af53-31c6a7df0db4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.558657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.559456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.559735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.560004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.583949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.585402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:40.614291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:40.615228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:40.616113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:40.616113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:40.616113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:40.616113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:40.616781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 362/731] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:40.626905 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.665642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9e4c-d557-43d6-92dd-4959de4661e2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.667580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:40.706547 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.707622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.708129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.708607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.709670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:40.710211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.716220 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.749741 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:40.757681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 370/732] 10.222.0.30 () {56 vars in 1149 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:40.763540 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.834056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa532dd-e9c0-4226-be6f-b0f2bff4437c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.915776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.916462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.916748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.917025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:40.917769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:40.918103 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:40.919491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:40.928649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55271-f216-4f85-ba13-8dced00da713 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:40.945377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 363/733] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:40.951055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:40.968901 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:40.969481 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:40.969767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:40.970073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.002998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.050397 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.052473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.163783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 371/734] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:41.170621 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.191063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504288-1fe7-4fec-8b24-497d58d57e74 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:41.214761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.226849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:41.228095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.228376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.228646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.236208 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.237642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.245298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3c8cb4b4-83b8-40f5-ab66-14bbffa9b51e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:41.253795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:41.254801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:41.255742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:41.261075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 364/735] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:41.262444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdd2d-8c68-45c0-9cbf-2ba44177e6db None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.262826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdd2d-8c68-45c0-9cbf-2ba44177e6db None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.263001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdd2d-8c68-45c0-9cbf-2ba44177e6db None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.264957 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 365/736] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:41.265797 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecdd2d-8c68-45c0-9cbf-2ba44177e6db None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.298041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df443-e888-401c-bccc-1bc854442d9d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:41.337527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:41.338757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.339299 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.339775 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.350966 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.353262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e0207f47-3bed-47e2-8fed-073d884ad391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:41.372942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:41.373897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:41.374974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:41.374974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:41.374974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:41.374974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:41.376901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecdd2d-8c68-45c0-9cbf-2ba44177e6db None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:41.377303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 372/737] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:41.378719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.379153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.379629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.397739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:41.399357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:41.423691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:41.424360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.424777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.425185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.426051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:41.426360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.428289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.462501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 366/738] 10.222.0.30 () {56 vars in 1135 bytes} [Tue May 24 09:03:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:41.464598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.483392 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 373/739] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:41.484252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.521088 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.578400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.591104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb6ca-7cf9-4104-a1f7-0beb8e67576a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:41.599983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52cdf4-e736-4702-8f37-2786bbc0e9d3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:41.629635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:41.630256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.630540 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.630817 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.646033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:41.647205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.647634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.648289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.650256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:41.650709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.652534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.672083 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 367/740] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:41.673274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.708992 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.710627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.763509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.786356 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:41.789828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e016f-88e4-4fb3-b518-1aba87b47830 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:41.828046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:41.829007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:41.829519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:41.830021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:41.830939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:41.833954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 374/741] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:03:41.833954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.837796 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:41.857045 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 368/742] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:03:41 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:41.857878 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:41.959373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9bbd0-3ac8-4705-beac-a6a13c94f3ce None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.000012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273006b4-4ecb-450d-bca6-7245e24b4d40 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.004275 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.005082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.005363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.005635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.014096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.015522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-70188fce-ef05-4789-a83c-a7a12956fcd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:42.030487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:42.031437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:42.032912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 375/743] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:42.036750 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606390e-7fe8-4874-ac0c-04a311f0ff40 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.037032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606390e-7fe8-4874-ac0c-04a311f0ff40 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.037309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606390e-7fe8-4874-ac0c-04a311f0ff40 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.038768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 376/744] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:42.039381 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.040728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.041075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.041427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.042013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606390e-7fe8-4874-ac0c-04a311f0ff40 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.045791 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:42.056995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.058640 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6ca102a7-eb3a-483a-99b6-beb8b055a07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:42.082485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:42.084690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 369/745] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.087567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.108239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:42.109989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:42.119884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:42.205018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 370/746] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:42 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:03:42.205885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.206125 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606390e-7fe8-4874-ac0c-04a311f0ff40 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.267484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.268159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.268515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.268860 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.269725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:42.270132 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.271641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.289279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 377/747] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:42.291350 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.342430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c947cbf-1ef6-4605-8b13-ac860c48dd1e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.357246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:42.386677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.387345 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.387632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.387907 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.388631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:42.388944 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.390361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.397624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:42.398018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f1de2-6c70-4892-ab3d-23f6deab45c2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.408178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 371/748] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:42.409358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.437341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c1762-116a-4d3c-8393-441cc6c06e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.438053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c1762-116a-4d3c-8393-441cc6c06e18 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.438342 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c1762-116a-4d3c-8393-441cc6c06e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.438747 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c1762-116a-4d3c-8393-441cc6c06e18 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.439475 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c1762-116a-4d3c-8393-441cc6c06e18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.440863 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c1762-116a-4d3c-8393-441cc6c06e18 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.460691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 378/749] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:03:42 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:42.460691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08dcd9-fb90-4f65-bca6-d902843e977e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.460691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08dcd9-fb90-4f65-bca6-d902843e977e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.460691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08dcd9-fb90-4f65-bca6-d902843e977e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.460691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 379/750] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:42.460691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08dcd9-fb90-4f65-bca6-d902843e977e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.542102 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ed9cd-212f-45c1-a058-ca83b431b953 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.589761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.590646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.590999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.591217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.592113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=ac1aee8389d44275a5f0ffe6d971d349) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:42.592431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.593976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2c1e-bd84-4ea3-b9fc-1268533014dc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.594479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08dcd9-fb90-4f65-bca6-d902843e977e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.600966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 372/751] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/role_assignments?user.id=ac1aee8389d44275a5f0ffe6d971d349&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:42.602439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.602772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.603056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.623730 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:42.625007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:42.629503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:42.651660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.652557 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.652845 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.653120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.662573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.664131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.694313 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:42.697120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:42.698247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:42.699143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:42.706109 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 380/752] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:42.707946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.714120 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 373/753] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:42.741441 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.861279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425ec0f-ce15-41ad-8ad1-c5ee27c0d2f6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.864779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190dc6-fa81-4ae7-903f-444ec684c46f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:42.913431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.914369 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.914577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:42.914693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.915456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.915807 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:42.916352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:42.916352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:42.917506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:42.917875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:42.919887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:42.929340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:42.934322 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 381/754] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:42.942058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:42.942987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:42.943830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:42.944471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 374/755] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:42.945127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:42.951050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:43.034821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:43.052342 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:43.140485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402939d1-0ee2-44e8-b56d-f6625394040d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:43.168981 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6faf4f-3435-4fdd-84e4-802a135a6359 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:43.205619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:43.208131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:43.208630 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:43.210135 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:43.211203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=cda4a224028a47f9afef8b443eb59a4c) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:43.215484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:43.217234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:43.238054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 382/756] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/role_assignments?user.id=cda4a224028a47f9afef8b443eb59a4c&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:43.259501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:43.260204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:43.260487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:43.260764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:43.261544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:43.261854 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:43.263377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:43.282684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 375/757] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:43.288005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:43.410363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcf74c-5a7b-4a46-bb51-201b8b880baf None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:43.445930 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:43.457005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:43.458205 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:43.458723 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:43.459208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:43.480144 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:43.486144 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:43.512780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:43.513730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:43.514642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:43.514642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:43.514642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:43.514642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:43.516609 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 383/758] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:43.523902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:43.676072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a0815-6f8d-4236-8309-5c4f7f7e6f13 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:43.695420 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:43.730643 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:43.731330 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:43.731617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:43.731896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:43.732631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:43.732942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:43.734356 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:43.750726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 376/759] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:43.756524 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:43.903350 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9350-1131-4f54-be41-318e7036781a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:43.953092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:43.953873 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:43.954197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:43.954476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:43.963271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:43.964733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:43.986246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:43.987312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:43.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 384/760] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:03:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:43.993569 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:44.137346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05aeaa-5b32-436f-af47-0148f308eab9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:44.177492 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:44.178205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:44.178490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:44.178768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:44.179617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:44.179927 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:44.182086 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7fcbe-4981-4e75-8ce5-0b34a3501e1d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:44.207623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 377/761] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:03:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:44.215039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:44.275347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:44.402031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efb7c2-d33e-44c1-89ae-87619b405f37 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:44.433184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933de02-5027-4c73-833e-81f56da791e1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:44.433478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933de02-5027-4c73-833e-81f56da791e1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:44.433751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933de02-5027-4c73-833e-81f56da791e1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:44.435393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 378/762] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:44.448891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:44.450015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:44.450776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:44.451285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:44.451893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:44.452184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:44.452466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:44.463689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:44.465517 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:44.489358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:44.490326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:44.491230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:44.491230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:44.491230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:44.491230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:44.493680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 385/763] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:44.501875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:44.503117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:44.504302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:44.548377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:44.630358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 379/764] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:03:44.644920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:44.653629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:44.718040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6b204-fef2-4cfa-8d85-b589139e10cd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:44.753465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:44.754175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:44.754464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:44.754744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:44.755473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:44.755784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:44.757169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:44.782082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 386/765] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:44.788727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:44.826012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5abbf-5463-49b6-a318-8a1ca1ec7179 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:44.888260 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:44.889071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:44.889362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:44.889659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] PATH_INFO: `/v3/services/network` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:44.890501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:44.892234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:44.907792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:44.908861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:44.909706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 380/766] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:44 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:44.919031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:44.967652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61762bd-d03c-4fcc-a46f-e0ec13d6c2c2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:44.977137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:45.022368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:45.025223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.026072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.026361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.026871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.043956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:45.045468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:45.073614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:45.074588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:45.075464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:45.076356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 387/767] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:45.083132 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.170485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f1501-c098-47b8-915c-a41a91846f9c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:45.254361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.254959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.255237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.255510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.256278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:45.256584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:45.258099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:45.273282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 381/768] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:03:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:45.278602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.376655 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a1cc-17a0-4ed5-bf68-2b2124b9823f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:45.419209 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.419851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.420335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.420740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.421850 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:45.422226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:45.424369 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b7b1a-0512-414d-9231-4c0be23d2626 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:45.447008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 388/769] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:45.448865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d474-5c8f-4280-a059-afcf7d9ce1a7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.449362 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d474-5c8f-4280-a059-afcf7d9ce1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.449874 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d474-5c8f-4280-a059-afcf7d9ce1a7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.451702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 389/770] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:45.456609 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d474-5c8f-4280-a059-afcf7d9ce1a7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.463148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:45.483210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fed90-6d75-4946-b612-d1d7ccb6f4a0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:45.517656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:45.534400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.535346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.535630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.535908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.536636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] RBAC: Adding query filter params (type=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:45.536947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:45.538406 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5647924-c231-41c9-b399-93ee65f40266 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:45.553867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 382/771] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:03:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:45.556693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.557377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.557890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.577196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:45.578426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:45.585708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d474-5c8f-4280-a059-afcf7d9ce1a7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:45.623392 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1a51f-5071-4369-88fa-150c0de19abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.624285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a51f-5071-4369-88fa-150c0de19abb None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.624565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a51f-5071-4369-88fa-150c0de19abb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.624840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1a51f-5071-4369-88fa-150c0de19abb None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/10ba53ef4d604f33aa31e50d053f3641/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.626811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1a51f-5071-4369-88fa-150c0de19abb None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=10ba53ef4d604f33aa31e50d053f3641, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:45.628250 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1a51f-5071-4369-88fa-150c0de19abb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:45.643095 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 390/772] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:45 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/10ba53ef4d604f33aa31e50d053f3641/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:45.652676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 383/773] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:45.653798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.655281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4850-777d-43dd-9a59-e84dbaa0a4ef None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.655569 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4850-777d-43dd-9a59-e84dbaa0a4ef None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.655846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b4850-777d-43dd-9a59-e84dbaa0a4ef None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.657360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 391/774] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:45.663599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.663889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.664179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.704840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:45.706064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:45.790710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 392/775] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:45.790710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.791687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:45.820872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3d03c-d444-40aa-ab96-01a433582a93 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:45.846475 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:45.862579 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.863247 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.863536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.863814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.864602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] RBAC: Adding query filter params (interface=public, service_id=b3fee0d4ff134583af34c4259acbaf68, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:45.864916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:45.866334 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a780e0-6d99-41f0-8c9a-49ee99fd6db3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:45.874197 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 384/776] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:03:45 2022] GET /identity/v3/endpoints?service_id=b3fee0d4ff134583af34c4259acbaf68&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:45.877882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b8f-5940-45cd-8a38-fb0a5d48abf2 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.877882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b8f-5940-45cd-8a38-fb0a5d48abf2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.877882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b8f-5940-45cd-8a38-fb0a5d48abf2 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.877882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 385/777] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:45.877882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5b8f-5940-45cd-8a38-fb0a5d48abf2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.924379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65d508-e13b-414c-8718-fd275a7142ec None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:45.961645 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:45.962997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:45.963285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:45.963561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:45.974771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:45.983792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:45.984700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:45.985515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 393/778] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:45.986755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:45.994479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5b8f-5940-45cd-8a38-fb0a5d48abf2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.029123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.029968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.030257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.030532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.031187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.032586 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-717d4baf-1fae-4c10-89ff-f5c3d5556554 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:46.045467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:46.046725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:46.047636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 386/779] 10.222.0.30 () {56 vars in 1129 bytes} [Tue May 24 09:03:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:46.048454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f4654-163f-4376-9150-478dd5e39766 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.048454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f4654-163f-4376-9150-478dd5e39766 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.049112 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f4654-163f-4376-9150-478dd5e39766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.066443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-274f4654-163f-4376-9150-478dd5e39766 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:46.067625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-274f4654-163f-4376-9150-478dd5e39766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:46.069726 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.095529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.098862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c13d2-62b3-4de3-a84e-ff01f3d8a297 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.137072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.138045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.138520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.138934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.139765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.141448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.142953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 387/780] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:46.143796 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f4654-163f-4376-9150-478dd5e39766 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.151697 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 394/781] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:03:45 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.152815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.274061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3743cf-d7ef-4c42-81d5-cc5936df0711 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.275032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f4654-163f-4376-9150-478dd5e39766 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.315268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.316253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.316716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.317171 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.318222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:46.318732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.319073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.319747 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.320029 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.320306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.321089 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:46.321354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.321457 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.322815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.328564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.330103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 395/782] 10.222.0.30 () {56 vars in 1124 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.331233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.339023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 388/783] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.341081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.378982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.469333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f61f-a74c-46d2-bafe-d83ddc05ab1f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.503938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee636958-b888-4298-bde6-6366f8d841c5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.505706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.506594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.506970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.507340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.508147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:46.509136 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.511189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.517449 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 389/784] 10.222.0.30 () {56 vars in 1124 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.522624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.548045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.549428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.549724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.550036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.564960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:46.575344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:46.576920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:46.578028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:46.583168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 396/785] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:46.584022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.598721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.641884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888847c4-7c72-4a41-b911-dc25c29cc00b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.687169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.688097 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.688381 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.688652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.700674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.702306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.710053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:46.722497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:46.723443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:46.724337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:46.724337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:46.724337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:46.724337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:46.728443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 390/786] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:46.728872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933162-2469-40b8-9fc1-94bc5cd5417d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.729212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.774005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.775181 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.775672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.776719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.777738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] RBAC: Adding query filter params (interface=public, service_id=2c57acd0feb941579c07e2efcf89d0f0, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:46.778704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.781024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.797791 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 397/787] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/endpoints?service_id=2c57acd0feb941579c07e2efcf89d0f0&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.799061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.861561 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f66ac1-fe60-4961-a001-1970b881e820 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.879646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:46.905740 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.907287 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.907819 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.908625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.909936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:46.910479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.912876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.931965 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 391/788] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.931965 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:46.937968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ebea-672b-43b6-9a11-e38e73d218e4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:46.980079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:46.981126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:46.981620 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:46.982204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:46.983136 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:46.983675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:46.985256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:46.998727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 398/789] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:46.999980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.022895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.043558 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd597c-46cd-46e9-bf89-faa31afadcd3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.081282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.081983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.082322 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.082603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.083339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.084713 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.098456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 392/790] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:47.099246 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.112498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1c0ee-a9d8-4f10-a753-ea68b68223a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.151756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.153058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.153550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.154098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.166601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.168454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:47.187477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:47.188437 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:47.189348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:47.189348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:47.189348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:47.189348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:47.190364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.197898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 399/791] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:47.199490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.270364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.287417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa54d5-43a4-4783-8d98-9444e0ee5605 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.313595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21bf9-0417-4965-91dc-80c9e4e077f9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.353785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.355082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.355790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.356388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.356859 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.357652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:47.357780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.357994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.358272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.358712 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.360530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.370748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.377957 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.380702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 400/792] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:47.382198 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:47.406256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:47.407402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:47.408339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 393/793] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:47.415474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.544554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475857be-c4a5-492b-8114-f892bb2d99e6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.552337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.558634 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071a1b-fc18-43ea-8eb4-09d6b95533c0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.582709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.583389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.583671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.583943 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.584771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:47.585076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.587346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.594354 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.599022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.599831 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.600125 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.600403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.607201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 394/794] 10.222.0.30 () {56 vars in 1149 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:47.609854 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.612155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.612541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:47.629928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:47.630914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:47.631835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:47.636715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 401/795] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:47.638072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.723050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4550c-cc6e-4581-843e-df04794c680c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.751985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6a88-c3ea-4a5b-b45d-0f7a8fdd4e85 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.763158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.763958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.764234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.764505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.775859 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.777365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.793495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b713-9089-456c-9bba-07852722061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.796729 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b713-9089-456c-9bba-07852722061c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.797245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b713-9089-456c-9bba-07852722061c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.797754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b713-9089-456c-9bba-07852722061c None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:47.798991 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b713-9089-456c-9bba-07852722061c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:47.799532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b713-9089-456c-9bba-07852722061c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:47.801243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b713-9089-456c-9bba-07852722061c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:47.801354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:47.802217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:47.803544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:47.803544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:47.803544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:47.803544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:47.803544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 395/796] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:47.808764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.823917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.831995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 402/797] 10.222.0.30 () {56 vars in 1135 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:47.834064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b713-9089-456c-9bba-07852722061c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:47.922982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:47.950343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b713-9089-456c-9bba-07852722061c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.964084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f047da-28f1-4015-8457-54d14b1c710e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:47.989039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:47.990045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:47.990460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:47.990840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.002824 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.004577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:48.024489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:48.025678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:48.026587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:48.026587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:48.026587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:48.026587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:48.031451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 403/798] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:48.032739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.051298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.051972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.052256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.052531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.053263 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:48.053571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.054981 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.082379 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 396/799] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:48.087697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.135252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.142408 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24821e-61ee-4acf-a8d0-61882223a627 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.178074 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.181876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.182583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.182868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.183150 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.184755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:48.185065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.186676 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dd507-8830-49aa-86de-d0e5590df631 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.204482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 404/800] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:48.206065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04654c-49da-4659-886c-8e8b772e872b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.206363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04654c-49da-4659-886c-8e8b772e872b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.206648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04654c-49da-4659-886c-8e8b772e872b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.208506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 405/801] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:48.209724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04654c-49da-4659-886c-8e8b772e872b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.210923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fc336-4752-42b2-8e9d-03757958ea8a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.248316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.249144 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.249537 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.249821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.257578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.259660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5ede6819-a86b-48e7-8593-4de378bf5e12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:48.275783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:48.276724 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:48.277608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 397/802] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:48.281932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711be87-7116-434a-bc89-f271ee968423 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.281932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711be87-7116-434a-bc89-f271ee968423 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.281932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711be87-7116-434a-bc89-f271ee968423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.297893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b711be87-7116-434a-bc89-f271ee968423 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:48.299373 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b711be87-7116-434a-bc89-f271ee968423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:48.323791 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04654c-49da-4659-886c-8e8b772e872b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.361234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.362082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.362371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.362648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.371476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.372857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 398/803] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:48.373033 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.373717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711be87-7116-434a-bc89-f271ee968423 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:48.389410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:48.391503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:48.393622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:48.401937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 406/804] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:48.401937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.416270 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.447415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.490856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b711be87-7116-434a-bc89-f271ee968423 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.516147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4efbbd-5fd1-4560-97d1-d8f65d2fb613 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.527706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.528427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.528713 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.528994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.530015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:48.530329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.531772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.545055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 399/805] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:48.545998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.557578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.558268 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.558550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.558923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.559772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:48.560079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.561713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.580308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 407/806] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:48.581262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.651153 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2d1e-c0a0-4bd1-8781-6d6188848635 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.660105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.676575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.687028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa546e-b13f-4b3e-8691-ed6c603fcc7f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.691354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.692153 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.692440 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.692721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.704218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:48.712571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:48.713521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:48.714414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 400/807] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:48.715665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.728724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40e7a2-a3c1-434c-aaf5-dc98141db273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.729782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40e7a2-a3c1-434c-aaf5-dc98141db273 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.730115 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40e7a2-a3c1-434c-aaf5-dc98141db273 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.730398 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40e7a2-a3c1-434c-aaf5-dc98141db273 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/ac1aee8389d44275a5f0ffe6d971d349/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.745463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40e7a2-a3c1-434c-aaf5-dc98141db273 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=ac1aee8389d44275a5f0ffe6d971d349, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.746956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40e7a2-a3c1-434c-aaf5-dc98141db273 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.770171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 408/808] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:48 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/ac1aee8389d44275a5f0ffe6d971d349/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:48.770171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f5e6-a7a4-4679-9024-5b812cfd977f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.770171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f5e6-a7a4-4679-9024-5b812cfd977f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.770171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f5e6-a7a4-4679-9024-5b812cfd977f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.770171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 409/809] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:48.770171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079f5e6-a7a4-4679-9024-5b812cfd977f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:48.855640 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ce336-660a-433d-b475-95d3bf0dfd94 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.902608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079f5e6-a7a4-4679-9024-5b812cfd977f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:48.909414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95d1df-1a53-4084-a014-4fab50551599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.910352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d1df-1a53-4084-a014-4fab50551599 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.910642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d1df-1a53-4084-a014-4fab50551599 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.910999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d1df-1a53-4084-a014-4fab50551599 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/cda4a224028a47f9afef8b443eb59a4c/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.913812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95d1df-1a53-4084-a014-4fab50551599 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=cda4a224028a47f9afef8b443eb59a4c, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.916430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95d1df-1a53-4084-a014-4fab50551599 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.936488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:48.938728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 401/810] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:03:48 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/cda4a224028a47f9afef8b443eb59a4c/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:03:48.941963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.942154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.942613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.957215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:48.957918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:48.958161 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:48.958591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:48.959371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:48.959677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:48.962915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:48.968281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:48.970879 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:48.977950 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 410/811] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:48.981517 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.029256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:49.083485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 402/812] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:49.107784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.124558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bdd8d-0a68-4b2e-8b2c-41c09e86e898 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.169954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.170942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.171486 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.171767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.186948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.189246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:49.217708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:49.218666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:49.219553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:49.219553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:49.219553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:49.219553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:49.220213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 411/813] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:49.225668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.247761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ca03-b64a-402c-ac03-a291cb665709 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.280059 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:49.289855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.290953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.291331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.291657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] PATH_INFO: `/v3/services/network` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.292392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.293889 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:49.308823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:49.310093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:03:49.311121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:49.312982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 403/814] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:49 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:49.320051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.364127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:49.370295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ae9d4-d7bf-4602-89f4-4c9f4d1d406f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.415140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.416171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.416605 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.417185 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.418484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:49.418935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.420441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:49.435164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 412/815] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:49.440865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.461361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a3d41-9c34-41ae-b238-58973b20e645 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.528992 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.529791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.530220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.531046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.531515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] RBAC: Adding query filter params (name=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:49.531924 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.533563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:49.544231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 404/816] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:03:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:49.548032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.557514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:49.570053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81026f61-62de-47f3-8438-1b9fbfff27f4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.639454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.640256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.640539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.640813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.652051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.653513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:49.685267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:49.686325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:49.687235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 413/817] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:03:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:49.701157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.723165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7a70-5ed1-4968-bbc8-d8de5e608cbd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.725403 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:49.761501 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.762448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.763050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.763472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.764331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] RBAC: Adding query filter params (type=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:49.764784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.767034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:49.773626 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 405/818] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:03:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:49.783691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:49.944580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff9abb-994e-46b1-897b-92ca0277516e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.970169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9519b56-d1ee-4ed8-9d9a-7eff35b2a23a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:49.991240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:49.991917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:49.992199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:49.992475 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:49.993527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:49.993764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:49.995233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4cda5-eb88-4cf7-9b55-e9b06ecb6701 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.013776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 414/819] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:03:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:50.015254 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036052bc-98ce-4053-bb82-f546951c9eea None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.015551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036052bc-98ce-4053-bb82-f546951c9eea None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.016021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036052bc-98ce-4053-bb82-f546951c9eea None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.017524 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 415/820] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:50.022015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036052bc-98ce-4053-bb82-f546951c9eea None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.030033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f17ea1-3af4-4650-8373-36485de6e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.030980 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17ea1-3af4-4650-8373-36485de6e13d None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.031506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17ea1-3af4-4650-8373-36485de6e13d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.031978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f17ea1-3af4-4650-8373-36485de6e13d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.033029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f17ea1-3af4-4650-8373-36485de6e13d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.034799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f17ea1-3af4-4650-8373-36485de6e13d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.044626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:50.061521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 406/821] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:03:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:50.063297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.063815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.064333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.084025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:50.085682 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:50.104433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:50.181084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 407/822] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:50.218819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036052bc-98ce-4053-bb82-f546951c9eea None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:50.219413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.257726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.258958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.259246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.259521 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.347190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.348601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.370516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:50.434477 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc520c2-c9b7-43c2-ada7-ba143458ec96 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:50.482032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.482373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 416/823] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:03:50.483399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.483891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.484404 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.485284 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.486906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.491206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:50.502571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:50.503521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:03:50.504355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:50.507466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 408/824] 10.222.0.30 () {56 vars in 1129 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:50.514642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.530375 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:50.629991 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d09a96-a53c-457e-88e6-63265ddf0d02 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:50.651934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:50.652126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b210c-bb91-4692-86c7-b1f80f966f2c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:50.675745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.677307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.677745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.678458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.691956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.692118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.692882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.693275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.693645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.694251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.694576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:50.694974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.696894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.706048 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 409/825] 10.222.0.30 () {56 vars in 1124 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:50.707814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:50.719477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:50.720448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:50.721320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:50.721320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:50.721320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:50.721320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:50.723818 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 417/826] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:50.729467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.809624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:50.837737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f286f6-2c21-4437-9a0c-9d5b2af561b9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:50.851570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31554f24-d40a-43ea-9838-ad88d0f1ff4e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:50.882906 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.884317 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.884463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.884694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.885351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:50.885655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.887056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.896751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 410/827] 10.222.0.30 () {56 vars in 1124 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:50.897748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.907107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:50.907769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:50.908048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:50.908324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:50.909049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:50.909355 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:50.911018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:50.927604 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 418/828] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:50.928505 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:50.959974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:51.035235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b3d70-fe4d-49bd-a518-75c75138f79d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.042928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde5227-901e-4dd2-b270-723743ecb4bf None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.074895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.075624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.075907 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.076182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.077028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:51.078549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:51.086275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:51.087173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.089066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.089476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.089898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.099272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:51.100808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:51.102644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 411/829] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:03:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:51.124794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:51.125738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:51.126732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:51.129422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 419/830] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:51.136681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:51.264169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd346e-5063-4fb7-9319-20e0ece79d23 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.305592 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.306657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.307142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.307616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.308594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:51.309114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:51.310838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c796b5a-4304-488e-b3ba-64ca501ea647 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:51.324883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 412/831] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:51.330904 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:51.426686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:51.443637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa92f3b-4a11-4535-8a98-0915fa1e1b65 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.453484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b586de-4171-4e80-9c99-81fcac91bff5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.453769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b586de-4171-4e80-9c99-81fcac91bff5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.454089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b586de-4171-4e80-9c99-81fcac91bff5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.457203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 413/832] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:51.462430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed396-64cb-419b-8c86-a7fae156ab6b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.462720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed396-64cb-419b-8c86-a7fae156ab6b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.462989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bed396-64cb-419b-8c86-a7fae156ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.487095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-32bed396-64cb-419b-8c86-a7fae156ab6b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:51.489048 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-32bed396-64cb-419b-8c86-a7fae156ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:51.497424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.498467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.498937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.499964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.500999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=10ba53ef4d604f33aa31e50d053f3641) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:51.501535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:51.504101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:51.513051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 420/833] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:51 2022] GET /identity/v3/role_assignments?user.id=10ba53ef4d604f33aa31e50d053f3641&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:51.564045 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:51.589199 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 414/834] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:03:51.612460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:51.643509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a3449-d56f-4cd4-9fc5-74eada087000 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.643849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a3449-d56f-4cd4-9fc5-74eada087000 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.644069 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a3449-d56f-4cd4-9fc5-74eada087000 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.645720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 415/835] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:51.652493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.652780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.653044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.671547 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:51.672747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:51.741652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a92fb-2f6b-4346-bf31-05521bd8aa95 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.750657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 416/836] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:03:51.774990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:51.785867 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.786936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.787388 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.787826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.805654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:51.813753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:51.814753 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:03:51.815576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:51.818040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 421/837] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:51.822272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:51.842868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:51.907682 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c2de1-d085-428c-af3c-178d1d2ef240 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.922789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:51.941044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472322f-fbde-43fa-8222-72d7241824e1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:51.954241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.955415 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.955862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.956451 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.970397 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:51.981836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:51.982901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:03:51.983751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:51.984399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 417/838] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:51.989994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:51.990566 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:51.991492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:51.992067 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:51.992540 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:51.993836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:51.995234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:51.996821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.007829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 422/839] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:52.013552 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.102435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4124d1-ee17-4148-bf70-3108c1c6a8d8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.108683 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:52.140857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0dfd5-db8c-4189-a1ac-4f7660aae529 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.141879 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.142961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.143495 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.143971 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.144912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:52.145435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.147331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.157640 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 418/840] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:52.163251 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.187473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.188982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.189691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.190168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.198228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:52.202578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.204301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:52.222433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:52.223326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:52.224277 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:52.224277 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:52.224277 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:52.224277 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:52.226559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 423/841] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:52.232658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.288317 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04eeac-3a30-49af-9bbc-78ac8180191b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.331314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.332189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.332514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.332792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.348951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.350714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.368110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03dd9-aca1-46fd-af96-cd142347022f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:52.372352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:52.373218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:52.374159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:52.374159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:52.374159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:52.374159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:52.379443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 419/842] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:52.380325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.406346 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:52.418204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.419152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.419584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.420017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.420887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:52.421599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.423173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.437744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 424/843] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:52.443062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.470756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:52.487402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581e72-7ce2-4d89-a8dd-0cf2a99f0277 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.524171 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.524926 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.525207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.525482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.526228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:52.526534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.527917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.545972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 420/844] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:52.547017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.557542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c488fe5-f405-4d9a-be95-06db6185a4ee None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.593515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.594727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.595220 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.595698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.603407 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.605118 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:52.620417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:52.621329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:52.622643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:52.624908 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 425/845] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:52.633939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.652655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dc1f5-8ab6-4715-9f27-0d53fec6a332 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.687823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:52.692043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.692923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.693205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.693475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.702230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.703912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:52.719524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:52.720691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:03:52.721953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:52.725313 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 421/846] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:52.726270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.731512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:52.757986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a319-cbd9-400f-bf94-ade4e9674423 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.815192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.816128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.816565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.817450 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.818524 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:52.819415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.822346 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.844708 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abd01e-5f66-430f-ac70-e2ea6bb0194b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.850335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 426/847] 10.222.0.30 () {56 vars in 1149 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:52.852692 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.892389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:52.893350 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:52.893630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:52.893926 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:52.895443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:52.895759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:52.897310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:52.922071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 422/848] 10.222.0.30 () {56 vars in 1135 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:52.927819 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:52.981844 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f916-c20c-4dd1-96dc-35a32cfce5f7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:52.984616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.008861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.031725 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.032670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.032960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.033239 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.064553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddca3f7-7a2e-48b8-8be9-8dd57c33a813 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.112098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.113620 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.114373 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.115072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.122072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.123556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.197457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.199228 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.264337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.273995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 427/849] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:03:53.277453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.281941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.325987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 423/850] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:03:53.332059 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.415922 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2123-c22d-492d-b246-034c69752fcb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.440432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8cb5-a168-4fb2-8cb8-6affaf12ee7d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.463957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.465327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.465834 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.466358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.477601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.478326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.478606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.478876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.479936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.485561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.489945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.491454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:53.505251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:53.506288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:53.507235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:53.507235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:53.507235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:53.507235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7955c63c-34aa-4b32-9143-9e3272ffc46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:53.514376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:53.515300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 424/852] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56de7e-488f-46f7-b1d4-04a8139114a8 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56de7e-488f-46f7-b1d4-04a8139114a8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.516679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56de7e-488f-46f7-b1d4-04a8139114a8 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.517769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 425/853] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:53.518010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 428/853] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:53.518110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56de7e-488f-46f7-b1d4-04a8139114a8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.519347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.536432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.581440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.627901 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3b05f-2d48-4709-816b-ab784d79edc1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.640911 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56de7e-488f-46f7-b1d4-04a8139114a8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.667754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.668400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.668706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.668964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.669875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:53.670018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.671686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa426eee-a85d-43b4-944c-c661100d91c1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.677969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.678643 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.678929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.679210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.679931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:53.680274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.681641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.690169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 429/854] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:53.691419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.692047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.692167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.699352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 426/855] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:53.699352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.713698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:53.715015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:53.798256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 430/856] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:53.799216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.800339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.820124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb72169-f874-45dd-a88f-42b3e6fbb12d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.855292 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.856084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.856367 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.856646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.858111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:53.865046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.866513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:53.881336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:53.882347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:53.883233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 427/857] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:53.883747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.921945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913b634-b755-4efe-8d48-2e4ff45e8395 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:53.955615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:53.956398 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:53.956677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:53.956946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:53.964497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:53.965950 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:53.979281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:53.980317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:53.981421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 431/858] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:53.982037 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:53.987770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa686e14-92d5-4796-be95-46e5eb97da70 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.022548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.023333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.023614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.024531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.025107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.026510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.028239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f90749db-7668-479a-9750-a832b1df8791 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:54.038894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:54.040590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:03:54.041521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:54.043552 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 428/859] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:54.044804 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884cd33-49c4-47dd-89b5-95006d57f86c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.045096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884cd33-49c4-47dd-89b5-95006d57f86c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.045368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884cd33-49c4-47dd-89b5-95006d57f86c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.047234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 429/860] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:54.047941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884cd33-49c4-47dd-89b5-95006d57f86c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.091130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d7e77-97bc-42d1-a967-a59b24b17378 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.097790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:54.126526 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.127182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.127465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.127738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.128518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.128823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.130296 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.143009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 432/861] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:54.143628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.155156 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884cd33-49c4-47dd-89b5-95006d57f86c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.188786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.189446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.189733 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.190052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.190837 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.191148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.192578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0da5-dd48-46a5-9eb3-d7ea879ec112 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.205211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 430/862] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:54.206514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.206802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.207076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.223609 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:54.224795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:54.247491 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8503204-8b8f-41cc-8328-5f622e4b36a4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.277587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:54.282287 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.282962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.283243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.283529 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.284234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.284544 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.285931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.290547 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 433/863] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:54.291318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.292103 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 431/864] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:54.292917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.326570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:54.395697 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad17f-5ede-44bb-91ed-69fd31aafb47 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.401970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65feb48-ce1e-4102-a270-f9c986a134ca None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.430654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.431500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.431786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.432069 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.432898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=ac1aee8389d44275a5f0ffe6d971d349) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.433212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.434677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.436005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.436665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.436946 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.437220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.438080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=cda4a224028a47f9afef8b443eb59a4c) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.438400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.439857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.440494 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 434/865] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/role_assignments?user.id=ac1aee8389d44275a5f0ffe6d971d349&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:54.441271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.457123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 432/866] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/role_assignments?user.id=cda4a224028a47f9afef8b443eb59a4c&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:54.457123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.548765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:54.564082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:54.573601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c546-d2ae-4ede-a14e-0e763bf3ff67 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.608932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eee40-63e8-4f9e-ab38-2fc96603494e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.615522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.616573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.617054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.617530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.619129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.619632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.621390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.627666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 435/867] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:54.655065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.655908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.656189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.656459 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.657170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.658633 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:54.675133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:54.676147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:54.677509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 433/868] 10.222.0.30 () {56 vars in 1132 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:54.682783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.812522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac05dd-98a8-42f7-b651-0196417f927f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.853417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:54.854121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:54.854407 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:54.854673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:54.855373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:54.855676 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:54.857050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c51a2-db54-40aa-ba66-16b3dd8b34cc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:54.862240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 436/869] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:54.867447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:54.974764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49475ca4-c7f6-464f-a539-ce8e6bffca73 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:54.998642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:55.011113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:55.011787 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:55.012075 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:55.012358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:55.013072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:55.013383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:55.014791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4b2b7-cc8c-4027-9a7e-9f0818f2ac91 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:55.019817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 434/870] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:03:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:56.827272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a1f1-c97f-4f27-b7fa-81e01603ccba None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:56.827827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a1f1-c97f-4f27-b7fa-81e01603ccba None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:56.827827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a1f1-c97f-4f27-b7fa-81e01603ccba None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:56.829470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 437/871] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:56.834882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26fcc-533d-42e8-a8bd-9cb2bb57d1d2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:56.835717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26fcc-533d-42e8-a8bd-9cb2bb57d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:56.836768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26fcc-533d-42e8-a8bd-9cb2bb57d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:56.855255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b0e26fcc-533d-42e8-a8bd-9cb2bb57d1d2 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:56.857307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b0e26fcc-533d-42e8-a8bd-9cb2bb57d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:56.876673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ea61-24e6-41f1-bd49-ee7b5878591f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:56.876969 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ea61-24e6-41f1-bd49-ee7b5878591f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:56.877246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ea61-24e6-41f1-bd49-ee7b5878591f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:56.878911 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 438/872] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:56.884575 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:56.884863 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:56.885148 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:56.903283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:56.904490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:56.922777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:56.946359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 435/873] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:03:56.952446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759c0d4-a64a-43a0-ac82-3c1deb41057f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:56.952737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759c0d4-a64a-43a0-ac82-3c1deb41057f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:56.953018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759c0d4-a64a-43a0-ac82-3c1deb41057f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:56.954529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 436/874] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:03:56.959245 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:56.959532 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:56.959826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:56.977846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:56.979054 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:56.988863 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 439/875] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:03:56.993265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.054514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 437/876] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:03:57.056485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.099554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.112058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48fd91-bb05-42b5-9e9c-78bb10b93b97 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.150409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.151214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.151500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.151774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.152432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.153804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:57.167637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:57.168637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:57.169460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 440/877] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:03:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:57.170310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.176677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458e44-308e-41c1-adb9-0913b534d16d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.190176 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.213573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.214449 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.214735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.215010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.225478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:03:57.234193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:57.235161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:57.236005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 438/878] 10.222.0.30 () {56 vars in 1120 bytes} [Tue May 24 09:03:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:57.237179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.285097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7246-df6c-42cd-831a-c0589b56b311 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.322093 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.322680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.322965 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.323247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.323971 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.325348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.340199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 441/879] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:03:57 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:03:57.340994 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.354386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.358989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d645cd9-99c9-4f4e-bd7c-27701db60c6a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.406545 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.407254 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.407539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.407821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.408548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:57.408866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.410322 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42151c-eae1-4cc4-8225-00bb03c98015 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.416652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 439/880] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:03:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:57.418709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e30381-2237-492a-bae7-6b66be2eedd3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.419189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e30381-2237-492a-bae7-6b66be2eedd3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.420305 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e30381-2237-492a-bae7-6b66be2eedd3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.422876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 440/881] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:57.425239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e30381-2237-492a-bae7-6b66be2eedd3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.433746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.465207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66730fb-4dec-470f-9de9-c7553effc3ba None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.502636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.503314 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.503603 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.504006 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.504798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:57.505089 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.506531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92557ba4-c765-4990-b53e-75383d66450d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.515556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 442/882] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:03:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:57.516864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.517158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.517441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.537412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:57.538648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:57.555018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e30381-2237-492a-bae7-6b66be2eedd3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.591519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.592119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.592404 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.592680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.593413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:57.593717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.595117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.600149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 441/883] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:03:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:57.600917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.625089 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 443/884] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:57.634690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.647888 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.732702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc457b82-a3e9-423e-be69-0331f3e0dee7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.750397 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.776534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.777632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.778127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.778578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.792237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce0a13-f84c-4e65-87a1-4d73a0102b32 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:57.804576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.806612 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:57.826400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:57.827340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:57.828220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:57.828220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:57.828220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:57.828220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:57.830456 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 442/885] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:57.832344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:57.833021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:57.833308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:57.833588 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:57.834364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:57.835805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:57.836433 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:57.863292 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 444/886] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:03:57 2022] POST /identity/v3/services => generated 269 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:03:57.941027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:57.967683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbaba8-3296-422a-8414-7810f3c0e8ac None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:58.013650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:58.014364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:58.014647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:58.014922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:58.015658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:58.015968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:58.017365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:58.031508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 443/887] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:03:58.036682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:58.151496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b24de-4764-49b4-a2b5-e72bd1886861 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:58.181266 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:58.191445 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:58.192272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:58.192573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:58.192832 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:58.202147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:58.203606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:03:58.219496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:58.220508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:03:58.221861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 445/888] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:03:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:58.226650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:58.328836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63521-42b3-4239-98c0-fc31753d0f9c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:58.363250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:58.371184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:58.371916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:58.372204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:58.372481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:58.373371 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:58.373687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:58.375152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:58.393820 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 444/889] 10.222.0.30 () {56 vars in 1149 bytes} [Tue May 24 09:03:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:58.400058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:58.504463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f644-e2fd-450f-99da-03ebcacaed84 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:58.541329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:58.542013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:58.542301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:58.542576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:58.602374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:58.615441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:58.616912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:58.720513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 446/890] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:03:58 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:03:58.725985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:58.844364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a9bd6-340f-4740-a499-7d0252a9469a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:58.879806 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:58.880608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:58.880892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:58.881170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:58.891960 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:58.893406 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:03:58.911660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:58.912549 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:58.914180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:03:58.914180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:03:58.914180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:03:58.914180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:58.914180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 445/891] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:58.919099 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:59.008962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:59.021585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e5c60-8fd3-4be0-af32-4253b1a4ad43 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:59.058347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66856a-2663-4832-b969-84447e647994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:59.058935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66856a-2663-4832-b969-84447e647994 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.059218 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66856a-2663-4832-b969-84447e647994 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.059496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66856a-2663-4832-b969-84447e647994 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.060219 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66856a-2663-4832-b969-84447e647994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:59.060524 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66856a-2663-4832-b969-84447e647994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:59.061900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66856a-2663-4832-b969-84447e647994 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:59.074311 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 447/892] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:59.079715 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:59.131596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:59.192110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b90d4-e264-407c-9a86-12c25e8d5f75 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:59.229342 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:59.230178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.230469 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.230751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.237945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:59.239401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:03:59.254327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:03:59.255249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:03:59.256117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 446/893] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:03:59.262853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66856a-2663-4832-b969-84447e647994 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:59.369227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66856a-2663-4832-b969-84447e647994 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:59.405537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:59.406593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.407119 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.407605 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.408605 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:59.409130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:59.410802 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcd295-24bb-471a-a373-ac5af2ed40da None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:59.424711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 448/894] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:59.430865 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:59.547222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d513794-72a8-4ea2-b424-c2c6ba9c4311 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:03:59.549325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:59.585130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:03:59.585795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.586746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.587081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.587917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] RBAC: Adding query filter params (role.id=f22d5e97800e4e7abed01365fe86e06c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=ac1aee8389d44275a5f0ffe6d971d349) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:03:59.588229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:03:59.589674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c32c7c-5006-407c-8239-bf732bf743d5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:03:59.596016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 447/895] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:03:59 2022] GET /identity/v3/role_assignments?user.id=ac1aee8389d44275a5f0ffe6d971d349&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=f22d5e97800e4e7abed01365fe86e06c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:03:59.720579 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126bf6f-8532-4a73-90ec-b353833a6b4b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.721294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126bf6f-8532-4a73-90ec-b353833a6b4b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.721786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126bf6f-8532-4a73-90ec-b353833a6b4b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.723863 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 449/896] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:59.730913 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a88a-0979-4b2b-9976-4626c35dff29 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.731553 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a88a-0979-4b2b-9976-4626c35dff29 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.732043 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a88a-0979-4b2b-9976-4626c35dff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.752618 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ca28a88a-0979-4b2b-9976-4626c35dff29 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:59.754379 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ca28a88a-0979-4b2b-9976-4626c35dff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:59.838017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 448/897] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:03:59.856454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126bf6f-8532-4a73-90ec-b353833a6b4b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:03:59.867611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:03:59.893343 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6471b-2447-4837-8c5b-7819d81337b9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.894327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6471b-2447-4837-8c5b-7819d81337b9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.894821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6471b-2447-4837-8c5b-7819d81337b9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.896615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 449/898] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:03:59.904548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:03:59.905108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:03:59.905492 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:03:59.923938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:03:59.925627 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:03:59.973656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126bf6f-8532-4a73-90ec-b353833a6b4b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.021683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 450/899] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:03:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:00.023370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.024534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.024799 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.025083 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.025803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.027404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:00.040795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:00.041810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:00.043129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 450/900] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:03:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:00.047830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.050895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.077984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:00.131721 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:00.167888 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19870e72-15b8-425c-9d5c-f33845921da7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.170343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216d12a-b44c-4be2-85b9-a41ff4c1ca0b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.207365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca1e86-1b4c-458d-9289-472e7044a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.208492 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1e86-1b4c-458d-9289-472e7044a301 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.209054 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1e86-1b4c-458d-9289-472e7044a301 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.209512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1e86-1b4c-458d-9289-472e7044a301 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.210654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca1e86-1b4c-458d-9289-472e7044a301 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.212472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca1e86-1b4c-458d-9289-472e7044a301 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.213391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.214459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.214857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.215200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.216081 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:00.216451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.218151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.230577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 451/901] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:04:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:00.238440 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 451/902] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:04:00 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:00.244058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.335192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7395e-75df-4af7-8341-f35115f8da6d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.335830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7395e-75df-4af7-8341-f35115f8da6d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.337076 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7395e-75df-4af7-8341-f35115f8da6d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.339196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 452/903] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:00.348328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.350644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.351116 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.388615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:00.390457 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:00.435530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26365-a789-49a2-b89c-6666939dac3c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.488189 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:00.495694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.496500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.496877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.497240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.498084 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:00.498477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.499955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.512593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 452/904] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:04:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:00.515599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.534479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 453/905] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:00.558557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.580490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:00.636546 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b7ce-e1de-4d4d-80a5-d1208f3db4f0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.675130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.676048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.676508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.676931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.677862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] RBAC: Adding query filter params (interface=public, service_id=7024c43c7bed491eb31a8660cf31a3d2, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:00.678347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.679894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.690211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 453/906] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:04:00 2022] GET /identity/v3/endpoints?service_id=7024c43c7bed491eb31a8660cf31a3d2&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:00.691651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.745068 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6073155-c57d-4e66-a5cc-acb33b7758b2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.757551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:00.804042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.805395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.805988 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.806480 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.807207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac10e02-b6b0-454e-b546-35242f2b9038 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:00.807763 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.809477 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:00.827707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:00.828739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:04:00.829559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:00.835293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 454/907] 10.222.0.30 () {56 vars in 1132 bytes} [Tue May 24 09:04:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:00.840661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:00.853359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:00.854072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:00.854367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:00.854640 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:00.855333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:00.856707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:00.874657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 454/908] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:04:00 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:04:00.958249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:00.981179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d8b68-966d-49ca-8388-45bc47ca81aa None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:01.018720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:01.019314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:01.019598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:01.019875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:01.020592 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:01.020900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:01.022335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:01.028660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 455/909] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:01.033979 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:01.147829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4422d8d-5a23-4de4-8bc9-391d8f674f75 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:01.173757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:01.185760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:01.186484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:01.186772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:01.187050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:01.187759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:01.188069 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:01.189454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:01.195184 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 455/910] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:01.201490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:01.313038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c72d4-043a-4c7f-9dc4-a8550d28cd5d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:01.348301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:01.348962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:01.349247 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:01.349523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:01.350338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] RBAC: Adding query filter params (interface=public, service_id=fd6cc1fc388e4646abfc2c5943e78dfa, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:01.350650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:01.352119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f88f10-ab70-483a-9697-40d080e5afe4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:01.357945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 456/911] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:04:01 2022] GET /identity/v3/endpoints?service_id=fd6cc1fc388e4646abfc2c5943e78dfa&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:01.363464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:01.474196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730458b2-3c60-4e25-b426-3760f46304ec None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:01.513022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7be3b8-4fd5-41f1-bfa7-5b9baa5f02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:01.514101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be3b8-4fd5-41f1-bfa7-5b9baa5f02ce None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:01.514621 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be3b8-4fd5-41f1-bfa7-5b9baa5f02ce None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:01.515119 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7be3b8-4fd5-41f1-bfa7-5b9baa5f02ce None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:01.516023 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be3b8-4fd5-41f1-bfa7-5b9baa5f02ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:01.517625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7be3b8-4fd5-41f1-bfa7-5b9baa5f02ce None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:01.525179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 456/912] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:04:01 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:04:02.000316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4737a05-4c76-4872-8331-5cb0a30cb43d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.001337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4737a05-4c76-4872-8331-5cb0a30cb43d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.001850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4737a05-4c76-4872-8331-5cb0a30cb43d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.003739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 457/913] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:02.009434 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.010073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.010571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.028064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:02.029592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:02.080343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:02.106024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 457/914] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:02.125840 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4737a05-4c76-4872-8331-5cb0a30cb43d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.137875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:02.236711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4737a05-4c76-4872-8331-5cb0a30cb43d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:02.272310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:02.273127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.273408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.273978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.285634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:02.294508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:02.295462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:02.296581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:02.300852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 458/915] 10.222.0.30 () {56 vars in 1120 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:02.302260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.406195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6226d0-a374-457a-a810-9d4d20e06ad8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:02.445233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:02.446635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.446919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.447195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.448017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:02.448319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:02.449798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8178b-0d34-4ab3-9073-7fd40387e2c9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:02.463162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 458/916] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:02.464573 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.534751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:02.571225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa684-9c97-42c4-ba57-cb7dc9e208f4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:02.601046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272162b-a4d3-40b2-83e2-d976d352e366 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.601345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272162b-a4d3-40b2-83e2-d976d352e366 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.601644 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272162b-a4d3-40b2-83e2-d976d352e366 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.603858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 459/917] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:02.608346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:02.608784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.609079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.609205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.609370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.609476 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.609678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.620872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:02.622353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:02.628681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:02.630457 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:02.641702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:02.642694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:02.643570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:02.643570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:02.643570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:02.643570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:02.645996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 459/918] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:02.649585 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.679361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:02.721959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 460/919] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:02.739658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.785462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dc96d-69a9-4798-8b7b-f7e6ae9f824d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:02.813896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:02.833154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:02.834817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.835223 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.835597 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.836955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:02.837362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:02.838875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:02.855405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 460/920] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:02.860589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.875560 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56ce69-cd1d-4181-8bcd-33075b14a33b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:02.920469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:02.921602 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:02.922066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:02.922585 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:02.923269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:02.924653 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:02.943527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:02.944485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:02.945872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:02.952568 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 461/921] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:02.955104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:02.998554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9b22-1697-4533-b552-0c8c780b29ae None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.007710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.042767 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94587934-f444-4561-b701-be897f9112da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.043580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94587934-f444-4561-b701-be897f9112da None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.043861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94587934-f444-4561-b701-be897f9112da None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.044139 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94587934-f444-4561-b701-be897f9112da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.053919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94587934-f444-4561-b701-be897f9112da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.056124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94587934-f444-4561-b701-be897f9112da None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-94587934-f444-4561-b701-be897f9112da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:04:03.077079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:03.078414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:04:03.079346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:03.081993 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 461/922] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:03.085318 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94587934-f444-4561-b701-be897f9112da None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.097202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fc772-b8be-4000-8bc2-9958f0330f6f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.140914 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.142105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.142595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.142911 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.143308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.144222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:03.144761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.146780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.152561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 462/923] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:03.158187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.215385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94587934-f444-4561-b701-be897f9112da None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.253938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.254681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.254912 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.255193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.256035 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:03.256347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.258541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8f9b8-de26-471a-b461-7164f82ea5d9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.267657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98047c0b-203b-4fc8-9280-0b0d6e8f5f5a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.269478 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.277060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 462/924] 10.222.0.30 () {56 vars in 1149 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:03.278651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7fe35-db6c-4479-b80c-6fae75064258 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.278832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7fe35-db6c-4479-b80c-6fae75064258 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.279117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7fe35-db6c-4479-b80c-6fae75064258 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.280613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 463/925] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:03.282565 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7fe35-db6c-4479-b80c-6fae75064258 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.309302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.310415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.310923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.311415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.312204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:03.312513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.314151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b816c7-a432-4680-87c8-a7f89a997bf7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.322071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 463/926] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:03.322071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.322371 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.322653 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.341180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:03.342650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:03.385974 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.391843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7fe35-db6c-4479-b80c-6fae75064258 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.426716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 464/927] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:03.427402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.427606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.428611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.429121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.429607 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.447925 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.450766 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:03.470512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:03.471422 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:03.472338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:03.472338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:03.472338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:03.472338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:03.476364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 464/928] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:03.477173 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.533872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.541391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe797f1-a311-4835-ac6e-8f5567a7e2c7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.576952 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.577620 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.577928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.578216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.579011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] RBAC: Adding query filter params (interface=public, service_id=c229162cad674bfbad5161ea31b86264, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:03.579325 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.580710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.586631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527238-8a47-4364-931b-d4ebbd5544df None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.591478 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 465/929] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/endpoints?service_id=c229162cad674bfbad5161ea31b86264&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:03.592209 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.625165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.626025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.626314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.626593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.627250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.628630 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:03.640901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:03.642010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:03.642850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 465/930] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:03.643651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.666021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.712800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eadff-b322-48de-9db4-2e3373f60974 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.752700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.753287 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.753568 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.754008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.754718 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:03.755053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.756416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.760564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48470a39-1df1-48b9-a9a5-cb6ac944bd32 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.772927 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 466/931] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:03.772927 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.801154 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.804416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.806173 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.806173 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.806498 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.807192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.808653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.815634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 466/932] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:04:03.822957 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:03.895935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fbda8-cdc2-4fdd-a41b-c5bcf4b56297 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.915014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:03.933403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.934131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.934416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.934694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.935408 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:03.935732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:03.937119 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf526-82fb-4c9e-935f-54bb4e417a88 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:03.942336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 467/933] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:03.943426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe00da-1024-4b04-b7b5-2110851cf693 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:03.943751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1856-448f-4517-948c-5c19e7ca492a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.944049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1856-448f-4517-948c-5c19e7ca492a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.944328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1856-448f-4517-948c-5c19e7ca492a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.946101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 468/934] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:03.951423 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.951841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.952128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.970038 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:03.971271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:03.989482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:03.990319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:03.990601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:03.990871 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:03.998623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.000117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:04:04.015976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:04.016885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:04.017776 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 467/935] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:04.018303 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.060539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 469/936] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:04.060539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.079060 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:04.126632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ef523-ee09-4573-b572-f16069c04ec1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.161518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.162212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.162499 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.162775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.163475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:04.163777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.165738 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.170613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 468/937] 10.222.0.30 () {56 vars in 1114 bytes} [Tue May 24 09:04:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:04.171659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.174242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:04.182597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f58b3-1ebc-45a8-bec7-24ac3dba24d5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.220943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.222001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.222467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.222957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.223898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:04.224370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.226238 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.238714 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 470/938] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:04.239709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.287799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02127d-249e-42a3-8759-a74bea7cc9a1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.321587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:04.324990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.325809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.326107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.326377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.327033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.328420 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:04.341041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:04.342234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:04.343105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 469/939] 10.222.0.30 () {56 vars in 1132 bytes} [Tue May 24 09:04:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:04.343964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.355992 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8200a-c9be-4453-ae08-0816e1701481 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.392416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.393079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.393363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.393635 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.394406 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.395784 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.418296 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 471/940] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:04:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:04.419461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:04.419574 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.473786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0e93-aa5b-44e5-9897-5c51d9f4dd66 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.532435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.533873 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.534843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.535334 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/ac1aee8389d44275a5f0ffe6d971d349/roles/f22d5e97800e4e7abed01365fe86e06c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.538903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=ac1aee8389d44275a5f0ffe6d971d349, role_id=f22d5e97800e4e7abed01365fe86e06c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.541506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.555366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71daa8-4d8f-4b68-a915-9447d81e0bbd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.562687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 470/941] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:04:04 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/ac1aee8389d44275a5f0ffe6d971d349/roles/f22d5e97800e4e7abed01365fe86e06c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:04:04.598843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:04.607888 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.608584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.608905 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.609510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.610537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:04.610980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.612498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.618919 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 472/942] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:04.624979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.744850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb242e-53f4-4309-a1ce-28c502406d3f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.775148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:04.788048 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.789623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.790264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.793124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.794111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:04.794608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.796425 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3676880-77b2-40f4-bbbf-6b03dcb7fd7e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.803828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 471/943] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:04.809534 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:04.919682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3df13-2ad4-4035-9a5c-b087cd8931ad None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:04.958294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332355-ab76-43da-bb0b-cc4353f5d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:04.959343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332355-ab76-43da-bb0b-cc4353f5d0fb None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:04.959830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332355-ab76-43da-bb0b-cc4353f5d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:04.960376 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332355-ab76-43da-bb0b-cc4353f5d0fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:04.961896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332355-ab76-43da-bb0b-cc4353f5d0fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:04.963498 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332355-ab76-43da-bb0b-cc4353f5d0fb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:04.984740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 473/944] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:04:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:06.065136 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08605ca5-fdb5-4c30-bb8d-c6744847b545 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.065654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08605ca5-fdb5-4c30-bb8d-c6744847b545 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.065654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08605ca5-fdb5-4c30-bb8d-c6744847b545 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.067252 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 472/945] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:06.073353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.073745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.073951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.092770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:06.093987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:06.145788 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:06.176083 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 474/946] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:06.199189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08605ca5-fdb5-4c30-bb8d-c6744847b545 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:06.308861 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08605ca5-fdb5-4c30-bb8d-c6744847b545 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:06.345575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:06.346329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.346612 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.346890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.347546 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:06.348922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:06.361664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:06.362716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:06.363538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 473/947] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:06.369528 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:06.475334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8e754-ae87-49fb-b81d-ff905607d090 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:06.510728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:06.511395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.511673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.511943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.512654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:06.512958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:06.514365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:06.519487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 475/948] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:06.526281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:06.578684 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:06.635780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b96d80-e64b-417a-bd5d-93c4e7f65035 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:06.674172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:06.674854 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.675134 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.675408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.676131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:06.676437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:06.677864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b27fb4-3a72-4c0e-a5e7-3c6082c1446f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:06.684192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 474/949] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:06.690232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:06.741252 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:06.806305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e52e4-422a-46ea-85fc-9ac8d4e7844c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:06.821124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951bdf9-2690-42c1-a67d-75dba47123cc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.821421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951bdf9-2690-42c1-a67d-75dba47123cc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.821698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951bdf9-2690-42c1-a67d-75dba47123cc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.823386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 475/950] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:06.828559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.828847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.829127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.841570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23378d83-c6e9-40f5-b930-f4c164a0c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:06.842312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23378d83-c6e9-40f5-b930-f4c164a0c5e9 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.842594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23378d83-c6e9-40f5-b930-f4c164a0c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.842918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23378d83-c6e9-40f5-b930-f4c164a0c5e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.843677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23378d83-c6e9-40f5-b930-f4c164a0c5e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:06.845057 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23378d83-c6e9-40f5-b930-f4c164a0c5e9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:06.846934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:06.848235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:06.865789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 476/951] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:04:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:06.902748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267a3c-8675-475e-b789-9637d9a7bd50 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.903117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267a3c-8675-475e-b789-9637d9a7bd50 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.903508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267a3c-8675-475e-b789-9637d9a7bd50 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.905364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 477/952] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:06.911293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:06.911868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:06.912327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:06.935752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:06.937408 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:06.948964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 476/953] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:06.973164 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.024202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.038286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 478/954] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:07.059727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.092622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.112521 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e61e6c-e313-4005-a933-a42c3d0507ad None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.162331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.162923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.163210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.163593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.164896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.166512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.167928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING keystone.server.flask.common [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 24 09:04:07.187687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.sql.core [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 09:04:07.187687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 24 09:04:07.187687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [parameters: {'id': 'f87ae9adf7104b9b92cc279bdb6568d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 24 09:04:07.187687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80388) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 09:04:07.197141 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d9a32-e3c7-4610-98e4-46cfe68e0482 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f87ae9adf7104b9b92cc279bdb6568d2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f87ae9adf7104b9b92cc279bdb6568d2. May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application conn.query(q) May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:04:07.210475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result.read() May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 24 09:04:07.211886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return project_ref.to_dict() May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application next(self.gen) May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application yield resource May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application next(self.gen) May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.session.rollback() May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.force_reraise() May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise self.value May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application session.commit() May 24 09:04:07.212815 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._prepare_impl() May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.session.flush() May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._flush(objects) May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application compat.raise_( May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application flush_context.execute() May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 09:04:07.213678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rec.execute(self) May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application c = connection._execute_20( May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 09:04:07.214616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application conn.query(q) May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result.read() May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:04:07.216934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [parameters: {'id': 'f87ae9adf7104b9b92cc279bdb6568d2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.218235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:07.230502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.Conflict( May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f87ae9adf7104b9b92cc279bdb6568d2. May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 477/955] 10.222.0.30 () {60 vars in 1140 bytes} [Tue May 24 09:04:06 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:07.231648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.245302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.246156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.246490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.246769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.262660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:07.273085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:07.275229 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:07.276885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:07.281929 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 479/956] 10.222.0.30 () {56 vars in 1120 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:07.283172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.336982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.345486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f81e52-dfc3-42f5-87d8-0305179413a6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.385230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.389283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.390209 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.390411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.390686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.398378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.400024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.400871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35321df-6141-4365-b9d3-067c80807124 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4252bb77-1fec-4ff1-b157-c9ae7b8dc4c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:04:07.414657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:07.415641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.416615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 478/957] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:07.417955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633bcc-9918-4f32-a1b7-d02ca0bc70c8 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.417955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633bcc-9918-4f32-a1b7-d02ca0bc70c8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.417955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633bcc-9918-4f32-a1b7-d02ca0bc70c8 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.422402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 479/958] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:07.423119 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81633bcc-9918-4f32-a1b7-d02ca0bc70c8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.448007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.448682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.448961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.449237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.450008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:07.450321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.451713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c62d-45e8-4342-adb3-41b3e4bc0ede None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.460790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 480/959] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:07.464693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.464988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.465267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.483240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:07.484471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:07.538095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81633bcc-9918-4f32-a1b7-d02ca0bc70c8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.558806 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 481/960] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:07.559563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.582825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.584114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.584863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.585782 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.587001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:07.587466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.589990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.621938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 480/961] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:07.621938 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.640232 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.667264 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.701312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822d4b-8578-4da3-a374-9bfb3706766e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.740568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ad1d2-7bcf-48ea-b4cb-5aaa627e85ab None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.750486 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.751313 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.751597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.751873 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.764433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.766098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.781945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.783002 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.783402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.783779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.784545 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.786073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:07.799562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:07.800616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:07.801525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:07.801525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:07.801525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:07.801525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:07.801745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:07.802719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:07.803594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 481/962] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:07.806714 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 482/963] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:07.814985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.815278 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:07.923688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.947369 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13907c7c-6f8e-41cd-ad80-8b98280e4b75 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.951773 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef584699-3142-4afc-b201-fabbb63d647c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:07.977793 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:07.985206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.986043 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.986430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.986900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.987901 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:07.988307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.989773 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:07.989985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.990475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:07.990767 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:07.991051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:07.991893 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:07.992836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:07.994240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:07.996542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 483/964] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:08.002495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:08.013450 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 482/965] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:08.018919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:08.127265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b6565-3ef7-42d4-83c0-4a80892d5ec7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:08.167354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e94a86-e4dc-4e2a-aec3-76d83a51d1c8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:08.180063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:08.181391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:08.181877 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:08.182599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:08.183988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:08.184766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:08.187085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:08.194316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 484/966] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:08.208408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:08.209255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:08.209539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:08.209817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:08.219088 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:08.220719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:08.224031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:04:08.239273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:08.240296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:08.241238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 483/967] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:04:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:08.247993 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:08.313889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:08.359685 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75775252-4e22-4df4-9802-17dd668dfa1d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:08.397395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:08.398102 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:08.398944 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:08.399226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:08.400263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:08.400571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:08.402169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:08.423871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 485/968] 10.222.0.30 () {56 vars in 1149 bytes} [Tue May 24 09:04:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:08.429642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:08.534619 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a564-62e0-4780-80c9-516ec3aac579 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:08.571531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:08.572227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:08.572513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:08.572790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:08.642363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:08.643318 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:08.644971 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:08.748755 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 484/969] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:08.754386 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:08.868227 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943e3bb-6e49-4a77-a41c-5e745dceece8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:08.885761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:08.905016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:08.905819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:08.906136 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:08.906413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:08.918029 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:08.919583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:08.939837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:08.940787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:08.941663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:08.941663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:08.941663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:08.941663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:08.941663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 486/970] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:08.947794 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.054429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:09.058472 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe8c2-16e5-460a-8e16-8db49af1532a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.095046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.095713 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.095995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.096270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.096985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:09.097289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.098677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8369a-1c6f-4cb0-b980-43082bc5d099 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.110563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 485/971] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:09.116103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.215298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae0d5-a1d4-4753-8409-a045beaefb57 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.215948 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae0d5-a1d4-4753-8409-a045beaefb57 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.216157 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae0d5-a1d4-4753-8409-a045beaefb57 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.218583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 486/972] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:09.223238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.223523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.223796 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.227460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336544f6-1a82-45ec-9503-9a7b03b09910 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.240673 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:09.242377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:09.276629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.277598 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.277994 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.278362 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.287015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.288996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:04:09.308674 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:09.310114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:09.311197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 487/973] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:09.316340 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.322100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 487/974] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:09.341350 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.347580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:09.431340 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192249-9274-46c2-b24d-7c6f365cd16c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.435668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:09.445848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d6d0-fec7-4424-8f8b-333093bd329f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.470835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.471506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.471788 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.472066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.472951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:09.473265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.474851 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.482099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.482994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.483355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.483691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.484407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.485836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.494792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 488/975] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:09.495728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:09.499191 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:09.501162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:09.503181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:09.509928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 488/976] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:09.509928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.593379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:09.610250 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e10f98-87a0-4f97-8af9-515ab729d3ea None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.612061 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d60082-0fbd-44cb-b5fc-77083ca78b36 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.648428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.649235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.649465 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.649621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.649896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.650093 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.650326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.650471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.650619 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:09.650924 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.651281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] RBAC: Adding query filter params (role.id=f22d5e97800e4e7abed01365fe86e06c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=ac1aee8389d44275a5f0ffe6d971d349) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:09.651596 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.652288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.653013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.662203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 489/978] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:09.663098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.666004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 489/978] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/role_assignments?user.id=ac1aee8389d44275a5f0ffe6d971d349&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=f22d5e97800e4e7abed01365fe86e06c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:09.702389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:09.779215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ece11-4ea9-4fdb-94da-9783edcfaffb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.816619 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.817297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.817576 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.817851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.818594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:09.818901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.820872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.826972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 490/979] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:09.832948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:09.947852 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caee32-0702-498b-86da-c442ad6b0c49 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:09.984684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:09.985351 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:09.985637 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:09.985931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:09.986727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] RBAC: Adding query filter params (interface=admin, service_id=c229162cad674bfbad5161ea31b86264, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:09.987041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:09.988424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd839e-0f7a-4a10-8919-8f7dcd66a75b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:09.994103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 490/980] 10.222.0.30 () {56 vars in 1249 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/endpoints?service_id=c229162cad674bfbad5161ea31b86264&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:09.999250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:10.086559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:10.105728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196603f5-98e2-4ba6-9dc2-15f039660a8a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:10.138019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ade3d7-0168-47ae-aa91-239aa84ba279 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.138358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ade3d7-0168-47ae-aa91-239aa84ba279 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.138757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ade3d7-0168-47ae-aa91-239aa84ba279 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.140363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 491/981] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:10.141023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:10.141932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.142454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.142887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.143706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:10.145323 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:10.145474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.145680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.145997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.154790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 491/982] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:04:09 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:04:10.166605 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:10.167831 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:10.182033 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:10.253747 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 492/983] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:10.279649 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:10.399489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712c2ac-9488-4cd1-a386-daf435e14246 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:10.437024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:10.437691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.437998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.438335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.439042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:10.440523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:10.455541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.sql.core [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 09:04:10.455541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 24 09:04:10.455541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [parameters: {'user_id': 'fc2bb06042d640749efa1c78ecb6bcb2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 24 09:04:10.455541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80388) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3059c030-9d55-425d-b3a4-1e7305a0cbb4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application conn.query(q) May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result.read() May 24 09:04:10.463461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:04:10.464368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application next(self.gen) May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application yield resource May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application next(self.gen) May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.session.rollback() May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.force_reraise() May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise self.value May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application session.commit() May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 09:04:10.465355 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._prepare_impl() May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.session.flush() May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._flush(objects) May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application compat.raise_( May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application flush_context.execute() May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rec.execute(self) May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 09:04:10.466306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = connection._execute_20( May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:04:10.467233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application conn.query(q) May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result.read() May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:04:10.468105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fc2bb06042d640749efa1c78ecb6bcb2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:10.468947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 24 09:04:10.469744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:10.470764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 492/984] 10.222.0.30 () {60 vars in 1131 bytes} [Tue May 24 09:04:10 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:10.481956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:10.516754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807358-0ea5-478c-bd4b-3c35fb72f584 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.517041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807358-0ea5-478c-bd4b-3c35fb72f584 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.517229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807358-0ea5-478c-bd4b-3c35fb72f584 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.526751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 493/985] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:10.528401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.528698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.528976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.547170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:10.548690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:10.550930 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:10.600703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2c72a-8aec-48c6-a6ff-4390a4bc68d1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:10.634121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 494/986] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:10.642745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:10.643556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.643836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.644111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.650248 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:10.651887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:10.653576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:04:10.673924 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:10.674903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:10.675838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 493/987] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:10.682074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:10.690751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:10.764790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc319-e9f1-402d-82ab-aa4468afae9d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:10.797302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882929-e9b8-4994-97a3-632b2aa28c63 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:10.812827 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff6ec-12ff-42d5-97df-cb6a305ad30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:10.813949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff6ec-12ff-42d5-97df-cb6a305ad30e None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.814441 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff6ec-12ff-42d5-97df-cb6a305ad30e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.814994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff6ec-12ff-42d5-97df-cb6a305ad30e None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.816035 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff6ec-12ff-42d5-97df-cb6a305ad30e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:10.817747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff6ec-12ff-42d5-97df-cb6a305ad30e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:10.827650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:10.842768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 495/988] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:04:10 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:04:10.850631 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:10.851991 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:10.852290 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:10.852751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:10.854187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:10.854775 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:10.856849 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2b89b-cbe6-4940-8f87-53b69a4ab832 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:10.905995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 494/989] 10.222.0.30 () {56 vars in 1101 bytes} [Tue May 24 09:04:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:12.069177 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d21ae-5db3-460c-9f12-c576167a623a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.069659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d21ae-5db3-460c-9f12-c576167a623a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.069659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d21ae-5db3-460c-9f12-c576167a623a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.071811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 496/990] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:12.076829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.077249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.077412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.095233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:12.096425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:12.157295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:12.170219 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 495/991] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:12.192528 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d21ae-5db3-460c-9f12-c576167a623a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:12.294688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d21ae-5db3-460c-9f12-c576167a623a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:12.329346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:12.330085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.330368 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.330639 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] PATH_INFO: `/v3/services/image` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.331286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:12.332670 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:12.345789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:12.346892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:12.347739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:12.349380 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 497/992] 10.222.0.30 () {56 vars in 1105 bytes} [Tue May 24 09:04:12 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:12.354031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:12.457283 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9520d-37d3-4aba-9c6e-0ba4500f4148 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:12.492511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764817c-a908-4698-8714-8692e37373db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:12.493174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764817c-a908-4698-8714-8692e37373db None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.493458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764817c-a908-4698-8714-8692e37373db None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.493735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764817c-a908-4698-8714-8692e37373db None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.494467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764817c-a908-4698-8714-8692e37373db None admin] RBAC: Adding query filter params (name=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:12.494776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764817c-a908-4698-8714-8692e37373db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:12.496152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764817c-a908-4698-8714-8692e37373db None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:12.505558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 496/993] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:12.506730 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:12.537616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98df01-9ff7-4679-9017-aacd60c8d45b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.537982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98df01-9ff7-4679-9017-aacd60c8d45b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.538207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98df01-9ff7-4679-9017-aacd60c8d45b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.540476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 497/994] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:12.546005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.546452 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.546743 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.565473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:12.566689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:12.581098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:12.623155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:12.627693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faca9ae-b7db-4238-a088-6f548f06269c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:12.642797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 498/995] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:12.663394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:12.664945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.665233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.665516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.666399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:12.666711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:12.667280 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:12.668089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:12.674056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 498/996] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:12.779021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b86e4-8009-4051-bc07-a82e081471b2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:12.825956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:12.826783 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:12.827069 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:12.827353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:12.828025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:12.829433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:12.842410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:12.843469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:12.844497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 499/997] 10.222.0.30 () {56 vars in 1126 bytes} [Tue May 24 09:04:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:12.849689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:12.960006 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b634f-899c-43ce-aad2-3843ef21cdf7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:12.990361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:13.001578 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.002294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.002582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.002859 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.003566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:13.003874 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.005244 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d414574-8d16-4047-a252-129d9cbe256b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.015364 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 499/998] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:13.016509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.067126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:13.121005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5d85d-074a-4b69-9b6a-76e716ed03ef None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:13.155642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.155845 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f09f9-cc30-42a1-9824-06b514a39c6c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.156256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f09f9-cc30-42a1-9824-06b514a39c6c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.156256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f09f9-cc30-42a1-9824-06b514a39c6c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.156424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.156662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.156854 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.157758 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:13.157860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 500/999] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:13.157962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.162610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.162896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.163187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.165732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 500/1000] 10.222.0.30 () {56 vars in 1122 bytes} [Tue May 24 09:04:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:13.171458 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.182994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:13.184184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:13.261961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 501/1001] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:13.277830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b69c-2f9b-426a-a91e-f230d444f465 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:13.282547 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.291597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:13.315974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.316638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.316920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.317196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.317962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.319335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.335441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 501/1002] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:04:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:04:13.394717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee45cc-596e-4645-9caa-f107080573b7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:13.419108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:13.443206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.444011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.444294 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.444566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.445926 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.447640 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:13.460124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:13.462266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:13.463172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 502/1003] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:13.471253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.582994 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59780a6-2f88-45da-9ab5-8df4a5ff35b6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:13.618262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.618937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.619224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.619503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.620211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:13.620518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.621890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.627154 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 502/1004] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:13.633441 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.735454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d7401-a60f-4609-8a38-6666559f5554 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:13.769603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.770374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.770661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.770941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.771647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:13.771957 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.773426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.783267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 503/1005] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:13.784427 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.831428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:13.900846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a80bb-a1a8-437f-9883-6e1ea04ad427 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:13.935618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:13.936279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:13.936563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:13.936840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:13.937627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] RBAC: Adding query filter params (interface=public, service_id=c3b19e2bc4e44d27ba87900c2f5f3194, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:13.937960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:13.939377 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2c00f-0497-4e76-9a5d-dbb93cc5095f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:13.948944 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 503/1006] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:04:13 2022] GET /identity/v3/endpoints?service_id=c3b19e2bc4e44d27ba87900c2f5f3194&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:13.950641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:13.997840 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:14.053847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4ff27-5cfd-4a61-8e38-b61a39b8adb8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:14.088034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197009df-db85-4233-90d3-40c27d69bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:14.088700 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197009df-db85-4233-90d3-40c27d69bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:14.088987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197009df-db85-4233-90d3-40c27d69bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:14.089268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197009df-db85-4233-90d3-40c27d69bbd0 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:14.089983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197009df-db85-4233-90d3-40c27d69bbd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:14.091359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197009df-db85-4233-90d3-40c27d69bbd0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:14.105935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 504/1007] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:04:13 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:04:14.925787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2ae4-d3ac-4b6e-8acb-c527fc2ad2d8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:14.926342 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2ae4-d3ac-4b6e-8acb-c527fc2ad2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:14.926453 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2ae4-d3ac-4b6e-8acb-c527fc2ad2d8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:14.927872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 504/1008] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:14.933019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf4ac3-ec22-46b8-8931-93fec916e453 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:14.933434 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf4ac3-ec22-46b8-8931-93fec916e453 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:14.933603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf4ac3-ec22-46b8-8931-93fec916e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:14.950770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bccf4ac3-ec22-46b8-8931-93fec916e453 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:14.951941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bccf4ac3-ec22-46b8-8931-93fec916e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:15.023908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 505/1009] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:15.046344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2ae4-d3ac-4b6e-8acb-c527fc2ad2d8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:15.144545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:15.150692 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2ae4-d3ac-4b6e-8acb-c527fc2ad2d8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:15.185116 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2a11-1d1e-4fb8-8800-ada1d28b7761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:15.185790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2a11-1d1e-4fb8-8800-ada1d28b7761 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:15.186101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2a11-1d1e-4fb8-8800-ada1d28b7761 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:15.186380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2a11-1d1e-4fb8-8800-ada1d28b7761 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:15.187103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2a11-1d1e-4fb8-8800-ada1d28b7761 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:15.188470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2a11-1d1e-4fb8-8800-ada1d28b7761 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:15.209958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 505/1010] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:04:15 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:15.597644 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1d992-bb01-494a-b409-38f83606f0a3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:15.598031 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1d992-bb01-494a-b409-38f83606f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:15.598240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1d992-bb01-494a-b409-38f83606f0a3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:15.599902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 506/1011] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:15.605228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:15.605523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:15.605800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:15.623980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:15.625168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:15.701947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 506/1012] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:15 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:15.724607 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1d992-bb01-494a-b409-38f83606f0a3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:15.768344 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:15.840063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1d992-bb01-494a-b409-38f83606f0a3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:15.874725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf3b0d-32bb-4366-93a0-9ab012b30c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:15.875448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3b0d-32bb-4366-93a0-9ab012b30c2f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:15.875736 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3b0d-32bb-4366-93a0-9ab012b30c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:15.876015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3b0d-32bb-4366-93a0-9ab012b30c2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:15.877211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf3b0d-32bb-4366-93a0-9ab012b30c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:15.878698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf3b0d-32bb-4366-93a0-9ab012b30c2f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:15.885614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 507/1013] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:15.886767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:15.973521 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:15.991643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2223f02-8a31-4d61-9ed4-2d8eee3d6f06 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:16.026094 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9f349-bb0d-4abc-ade8-4eeca08b84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:16.026766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9f349-bb0d-4abc-ade8-4eeca08b84c3 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:16.027054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9f349-bb0d-4abc-ade8-4eeca08b84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:16.027507 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9f349-bb0d-4abc-ade8-4eeca08b84c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:16.028228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9f349-bb0d-4abc-ade8-4eeca08b84c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:16.029684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9f349-bb0d-4abc-ade8-4eeca08b84c3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:16.065934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 507/1014] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:04:15 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:16.330934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e99c-9547-4e74-9eea-bac6222ebd12 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:16.331458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e99c-9547-4e74-9eea-bac6222ebd12 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:16.331567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e99c-9547-4e74-9eea-bac6222ebd12 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:16.332994 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 508/1015] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:16.339251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:16.339704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:16.339987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:16.357947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:16.359161 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:16.429477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 508/1016] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:16.452458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e99c-9547-4e74-9eea-bac6222ebd12 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:16.556744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e99c-9547-4e74-9eea-bac6222ebd12 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:16.564334 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:16.593592 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:16.595683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:16.595683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:16.595683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:16.595683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:16.596856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:16.609485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:16.610602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:04:16.611452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:16.614250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 509/1017] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:16.616722 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:16.689023 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:16.724309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce82b15-3daf-48ce-8459-a20c47718588 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:16.758760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:16.759432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:16.759720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:16.759997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:16.760703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:16.761009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:16.762426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:16.772023 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 509/1018] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:16.773306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:16.877362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9d3c-924b-45a8-9f73-b55b42bd2586 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:16.910828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:16.911489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:16.911770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:16.912045 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:16.912745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:16.913049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:16.914567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b59d6-1424-4f78-89aa-3f418f95f41f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:16.924329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 510/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Tue May 24 09:04:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:16.925503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:17.027400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61dc5f-a114-4609-957c-5042e37d7ca1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:17.057538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:17.063612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30695611-0338-460e-83b8-ca8342671dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:17.064659 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30695611-0338-460e-83b8-ca8342671dcc None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:17.064943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30695611-0338-460e-83b8-ca8342671dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:17.065214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30695611-0338-460e-83b8-ca8342671dcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:17.065978 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30695611-0338-460e-83b8-ca8342671dcc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:17.067347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30695611-0338-460e-83b8-ca8342671dcc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:17.087168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 510/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:04:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:17.497875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd13c-b28d-4f01-9966-771eaee01c63 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:17.498417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd13c-b28d-4f01-9966-771eaee01c63 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:17.498523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd13c-b28d-4f01-9966-771eaee01c63 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:17.499851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 511/1021] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:17.505011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:17.505303 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:17.505579 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:17.524168 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:17.525359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:17.599767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 511/1022] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:17.623096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd13c-b28d-4f01-9966-771eaee01c63 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:17.660157 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:17.731507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd13c-b28d-4f01-9966-771eaee01c63 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:17.767371 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:17.768081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:17.768360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:17.768632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:17.769273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:17.770904 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:17.783250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:17.784240 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:17.785085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:17.789978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 512/1023] 10.222.0.30 () {56 vars in 1105 bytes} [Tue May 24 09:04:17 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:17.791345 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:17.897121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7faeb-cd06-4945-9916-7b652628d8e9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:17.911738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:17.934523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:17.935198 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:17.935487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:17.935767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:17.936480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] RBAC: Adding query filter params (name=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:17.936790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:17.938199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:17.948597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 512/1024] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:17.949567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:18.048667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:18.053210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876cae-4f9a-44b8-aad0-a26db7b764c5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:18.087531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:18.088195 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.088480 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.088756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.089463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:18.089772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:18.091170 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:18.100529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 513/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:18.102411 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:18.209287 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce891d-f115-4286-879d-1c6f184cd245 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:18.245225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:18.245956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.246244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.246517 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.247348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] RBAC: Adding query filter params (interface=public, service_id=27045ee970224bafa4ce64b9c613d960, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:18.247660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:18.249022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f556-7c24-4291-b2c3-b4cab9876c00 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:18.260154 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 513/1026] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:04:18 2022] GET /identity/v3/endpoints?service_id=27045ee970224bafa4ce64b9c613d960&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:18.260303 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:18.336193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bc37-dbcb-4fec-8285-853d6105c80b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.336497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bc37-dbcb-4fec-8285-853d6105c80b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.336776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654bc37-dbcb-4fec-8285-853d6105c80b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.338326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 514/1027] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:18.343720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.344005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.344284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.365183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:18.366398 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:18.367027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7aa1a-14ee-4f06-b57d-482fe4b9fdd5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:18.402296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:18.402964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.403254 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.403534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.404219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:18.405591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:18.407358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:18.422127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 514/1028] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:04:18 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 09:04:18.446554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 515/1029] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:18.471454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:18.503332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:18.586891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18345-80c4-4dbc-904a-9e5e9ecb55ad None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:18.623638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aec67-080d-4cf3-99b0-d0c7ccfcef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:18.624466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aec67-080d-4cf3-99b0-d0c7ccfcef1c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.624750 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aec67-080d-4cf3-99b0-d0c7ccfcef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.625030 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aec67-080d-4cf3-99b0-d0c7ccfcef1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.626226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aec67-080d-4cf3-99b0-d0c7ccfcef1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:18.627660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6aec67-080d-4cf3-99b0-d0c7ccfcef1c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:18.629486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 515/1030] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:18.635109 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:18.736324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1bd12-a0a0-4149-babc-aa120a3d75a1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:18.770944 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfada8ff-8b86-48eb-9353-df37857abb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:18.771619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfada8ff-8b86-48eb-9353-df37857abb43 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:18.771901 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfada8ff-8b86-48eb-9353-df37857abb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:18.772178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfada8ff-8b86-48eb-9353-df37857abb43 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:18.772987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfada8ff-8b86-48eb-9353-df37857abb43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:18.774794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfada8ff-8b86-48eb-9353-df37857abb43 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:18.806072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 516/1031] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:04:18 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:19.420181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c7dd-41a1-44f2-9768-ce15dceb359d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:19.420746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c7dd-41a1-44f2-9768-ce15dceb359d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:19.421098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c7dd-41a1-44f2-9768-ce15dceb359d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:19.422634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 516/1032] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:19.427634 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:19.428067 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:19.428241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:19.447068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:19.448240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:19.471925 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:19.520426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 517/1033] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:19.545100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c7dd-41a1-44f2-9768-ce15dceb359d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:19.646817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:19.654971 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c7dd-41a1-44f2-9768-ce15dceb359d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:19.690838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:19.691650 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:19.691931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:19.692203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:19.703932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:19.712963 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:19.714242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:19.715085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:19.716230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 517/1034] 10.222.0.30 () {56 vars in 1120 bytes} [Tue May 24 09:04:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:19.720323 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:19.828530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323a36b-aed1-4c62-9bc5-227a6bfc654c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:19.862610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:19.863269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:19.863550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:19.863820 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:19.864556 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:19.864862 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:19.866248 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:19.874870 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 518/1035] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:04:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:19.880239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:19.982716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f6fd-d109-43b6-aa01-762e1c3edb79 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:20.018165 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:20.018955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.019235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.019502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.030120 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:20.031574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:20.053016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:20.054768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:20.055671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:20.055671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:20.055671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:20.055671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:20.057977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 518/1036] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:20.060554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:20.084717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:20.164754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a169a-64b8-4eeb-b28f-c9eb8f52389e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:20.198415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:20.199073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.199354 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.199628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.200343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:20.200646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:20.203785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:20.214985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 519/1037] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:20.220249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:20.229856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:20.323738 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e51c8-e90b-4acd-a296-0c5b286bca11 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:20.357160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:20.358305 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.358698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.359088 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.368221 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:20.370020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:04:20.387496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:20.388466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:04:20.389400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:20.394467 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 519/1038] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:20.395466 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:20.482976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:20.504199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd40a0-4540-4d5a-a251-45874f164aeb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:20.539677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:20.540351 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.540632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.540904 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.541728 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:20.542065 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:20.543489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbdd9c-ded4-444d-8dd5-983b912ccc2a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:20.565767 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 520/1039] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:20.567266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:20.637922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:20.643141 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e36c-a8e0-44e2-bbe4-ea0d00612b41 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.643848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e36c-a8e0-44e2-bbe4-ea0d00612b41 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.644125 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e36c-a8e0-44e2-bbe4-ea0d00612b41 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.646514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 521/1040] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:20.652162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.652454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.652732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.669549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:20.671041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:20.676008 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d38af-022d-47c7-87c0-92dad0b26ebf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:20.712798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:20.713005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.713278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.713554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.748028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 522/1041] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:20.770944 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:20.784111 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:20.785584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:20.852361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:20.860826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:20.887837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57e0d6-3d78-483d-882e-088c0d220481 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:20.902711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 520/1042] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:04:20.908681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:20.929169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:20.930222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:20.930509 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:20.930795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] PATH_INFO: `/v3/services/image` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:20.931464 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:20.932876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:20.945813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:20.946879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:20.947727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 523/1043] 10.222.0.30 () {56 vars in 1105 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:20.952890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.019685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c09109-1374-4926-b62b-051028e8c60a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.056146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.056942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.057226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.057500 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.062176 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876b75-56ed-4903-a626-a94dd1a9d696 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.068091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.069550 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:21.089860 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:21.090802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:21.091712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:21.091712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:21.091712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:21.091712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:21.091712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 521/1044] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:21.096753 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.097327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.103049 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.103714 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.104027 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.104304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.105008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:21.105316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.106715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0470e4-09b9-4a2f-b58b-95c334d2c1f1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.111536 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 524/1045] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:21.115412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.117896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbbb02-9a48-455c-bdcb-abf9e1a7cdd9 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.118199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbbb02-9a48-455c-bdcb-abf9e1a7cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.118474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbbb02-9a48-455c-bdcb-abf9e1a7cdd9 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.119735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 525/1046] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:21.120474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbbb02-9a48-455c-bdcb-abf9e1a7cdd9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.198096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f775de-f27b-4ad6-b54b-f20801ea8110 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.222530 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbbb02-9a48-455c-bdcb-abf9e1a7cdd9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.231866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.232527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.232816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.233095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.233814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:21.234151 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.235526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e28fe-7bfd-48de-bd7d-f43384f3047e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.246987 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 522/1047] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:21.248192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.248487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.248774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.256592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.257765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.258107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.258405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.259106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] RBAC: Adding query filter params (type=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:21.259409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.260769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.265316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:21.269989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 526/1048] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:21.269989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.270192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:21.326702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.336589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 523/1049] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:21.337538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.351138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.370659 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e4e1c-7a37-4da5-adcf-c20493855549 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.404310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.405097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.405380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.405654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.412205 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.414405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:04:21.428523 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:21.429629 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:21.430581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 527/1050] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:21.431062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.447021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513cf3d-d1af-458e-ba3f-0cb0084cc03b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.481109 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.481696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.482011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.482293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.483071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.484442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.502452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 524/1051] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:04:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:21.503250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.544532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea128d63-d749-4006-810a-794cc2f14a26 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.570292 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.578184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.596033 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.596978 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.597470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.597628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.611409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:21.619956 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:21.620958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:21.621811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 528/1052] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:21.627121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ddfcf-cf77-42fe-8a2a-ca363a849d32 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.627554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.665975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.666655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.666940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.667216 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.668005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:21.668320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.669781 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.684563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 525/1053] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:21.690680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.753887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41b3f2-6020-4578-9e82-cec72de59093 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.798651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.799343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.799535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2feb-b3fb-49e4-a7a9-154df06ccaeb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.799667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.799887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.800641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:21.801232 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.803543 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.818752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 529/1054] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:21.820730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:21.827531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.840694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.841399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.841690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.842000 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.842834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] RBAC: Adding query filter params (role.id=f22d5e97800e4e7abed01365fe86e06c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=10ba53ef4d604f33aa31e50d053f3641) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:21.843198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.844641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.858125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 526/1055] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/role_assignments?user.id=10ba53ef4d604f33aa31e50d053f3641&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=f22d5e97800e4e7abed01365fe86e06c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:21.866950 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:21.937019 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2972c-1fa0-4ed6-8aa8-61f4b1015110 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:21.974183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:21.975080 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:21.975361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:21.975633 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] PATH_INFO: `/v3/users/4ad4cc050d8645a6a70a06e4a3df8f89` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:21.990800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] RBAC: Authorizing `identity:get_user(user_id=4ad4cc050d8645a6a70a06e4a3df8f89)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:21.992544 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:21.994531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 530/1056] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/users/4ad4cc050d8645a6a70a06e4a3df8f89 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:22.000250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:22.110047 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b70fd-464e-49df-a657-aab645312db7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:22.147652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:22.148830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:22.149113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:22.149386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:22.204919 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:22.219204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:22.220661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:22.326847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 527/1057] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:22.328321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:22.424660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:22.431806 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3385f1-9d79-49a6-98f5-8e4a9ed868bc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:22.466009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeeeb2-84d9-48ba-b98e-3b4d4bf75db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:22.466864 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeeeb2-84d9-48ba-b98e-3b4d4bf75db5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:22.467147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeeeb2-84d9-48ba-b98e-3b4d4bf75db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:22.467421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeeeb2-84d9-48ba-b98e-3b4d4bf75db5 None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:22.468594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeeeb2-84d9-48ba-b98e-3b4d4bf75db5 None admin] RBAC: Authorizing `identity:get_project(project_id=df47920121c849859f53cbfc40107a10)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:22.470045 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeeeb2-84d9-48ba-b98e-3b4d4bf75db5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:22.471955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 531/1058] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:22 2022] GET /identity/v3/projects/df47920121c849859f53cbfc40107a10 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:22.477875 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:22.567196 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:22.581093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f48ec-1beb-493e-a1d5-12efc60f1945 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:22.615243 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:22.615897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:22.616181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:22.616498 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:22.617411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=df47920121c849859f53cbfc40107a10, user.id=4ad4cc050d8645a6a70a06e4a3df8f89) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:22.617723 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:22.619187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34b250-b7ec-425d-926d-73d1b499e296 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:22.629935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 528/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:22 2022] GET /identity/v3/role_assignments?user.id=4ad4cc050d8645a6a70a06e4a3df8f89&scope.project.id=df47920121c849859f53cbfc40107a10&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:23.752331 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f21c2-5856-4574-8a5b-0d060581ce74 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:23.752843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f21c2-5856-4574-8a5b-0d060581ce74 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:23.752921 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f21c2-5856-4574-8a5b-0d060581ce74 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:23.756818 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 532/1060] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:23.762104 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd88b7-1770-428e-937c-c26d5b73ea2b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:23.762591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd88b7-1770-428e-937c-c26d5b73ea2b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:23.762677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd88b7-1770-428e-937c-c26d5b73ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:23.780523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ecdd88b7-1770-428e-937c-c26d5b73ea2b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:23.781705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ecdd88b7-1770-428e-937c-c26d5b73ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:23.859134 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 529/1061] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:23.882499 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f21c2-5856-4574-8a5b-0d060581ce74 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:23.989203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f21c2-5856-4574-8a5b-0d060581ce74 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.024577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.025153 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.025473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.025818 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.039916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445e5ba-ef66-4062-8a91-f7ee1ca80b37 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.040217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445e5ba-ef66-4062-8a91-f7ee1ca80b37 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.040503 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445e5ba-ef66-4062-8a91-f7ee1ca80b37 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.041885 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 530/1062] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:24.046948 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.047237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.047516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.062562 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:24.064591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:24.065796 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:24.103613 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:24.105084 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:24.143852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 531/1063] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:24.166218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.181760 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:24.208308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 533/1064] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:24.214720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.282907 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7598dec-797d-4a3b-90cf-7869ee6b2db9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.283174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:24.318168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.319020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.319349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.320176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.325681 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb12e8-0088-4303-8099-526efeb4b320 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.330946 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:24.340289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:24.341299 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:24.342256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 532/1065] 10.222.0.30 () {56 vars in 1120 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:24.347242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.364380 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.365182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.365468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.365751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.376662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:24.378163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:24.396612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:24.397564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:24.404253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:24.404253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:24.404253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:24.404253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:24.404253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 534/1066] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:24.404253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.436681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:24.470230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ceec1-0576-4271-901c-5b7d4ff1ac29 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.510939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.511305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aeded-df97-491b-b4b9-8d5174d1c3e8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.511610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.511889 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.512162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.512900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:24.513205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:24.514611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:24.529155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 533/1067] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:24.530481 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.533750 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:24.555594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.556266 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.556553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.556832 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.557559 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:24.557868 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:24.559294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:24.571583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 535/1068] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:24.661758 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1a113-b2a1-4fb9-8e4a-a998d50df908 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.699411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.700227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.700509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.700784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.702978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:24.716227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:24.717711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e5e2a4f6-59ae-4e2b-a61a-07849a6aef56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:24.736360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:24.737353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:24.738737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:24.738737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:24.738737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:24.738737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:24.742734 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 534/1069] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:24.743580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.816071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786588-c94c-452c-8c3e-19e320d94d7c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.816598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786588-c94c-452c-8c3e-19e320d94d7c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.816598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786588-c94c-452c-8c3e-19e320d94d7c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.817996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 535/1070] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:24.824928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.825224 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.825508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.845192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:24.846429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:24.856982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94a1fb-5a27-4506-a901-cbcc3c2c2818 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:24.897290 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:24.898638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:24.898922 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:24.899194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:24.899910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:24.900212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:24.901578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:24.913648 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 536/1071] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:24.919508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.923183 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 536/1072] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:24.946323 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:24.953273 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.017193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192433-7076-4faf-9c56-b0acfc47a947 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.044378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46ce4-1ca1-4494-bc10-15cc59bc45db None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.051580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.052374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.052662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.052941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.060184 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.061254 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.061628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:04:25.076733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:25.077879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:25.079319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 537/1073] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:25.081394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.082215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.082733 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.082847 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.083513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.094041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:25.101638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:25.102722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:25.103571 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 537/1074] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:25.108591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.181899 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.188295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7314-05e8-4d21-a722-3fe20117c0d6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.209123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913ed53-8e0e-4ee0-9a04-7a7c0fc6a831 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.222102 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.222769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.223047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.223328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.228443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:25.228754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.230249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.242764 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.243421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.243702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.243977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.244721 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:25.245027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.246435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.248008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 538/1075] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:25.253172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.260009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 538/1076] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:25.261012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.300493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.351468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6debd19-d585-45b0-96e7-adc5b57f63f0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.359370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679d936-63ca-4311-83be-7789f0146085 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.385843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.386660 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.386943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.387219 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.392741 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.393606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.393892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.394192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] PATH_INFO: `/v3/users/4ad4cc050d8645a6a70a06e4a3df8f89` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.395385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad4cc050d8645a6a70a06e4a3df8f89)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.396822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.397293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.399272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 539/1077] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/users/4ad4cc050d8645a6a70a06e4a3df8f89 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:25.402088 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.404792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:25.418508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:25.419581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:25.420947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:25.420947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:25.420947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:25.420947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:25.420947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 539/1078] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:25.425285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.434980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.506564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fe61d-63bd-44f1-9d5e-b3a1c6545b35 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.513973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.528867 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772a5bb-a7de-4308-9b68-6efc98679769 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.541998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.542869 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.543150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.543428 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.544604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] RBAC: Authorizing `identity:get_project(project_id=df47920121c849859f53cbfc40107a10)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.546331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.548014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 540/1079] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/projects/df47920121c849859f53cbfc40107a10 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:25.553797 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.563119 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.563782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.564069 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.564353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.565073 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:25.565384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.566788 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.578928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 540/1080] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:25.584430 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.648902 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.655616 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee45d5-4c87-4dbc-b1a3-7de835ae7923 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.684557 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6eb6d-cb56-4969-a8f1-9043797ccffc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.689300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.690218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.690507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.690783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10/users/4ad4cc050d8645a6a70a06e4a3df8f89/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.692753 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=df47920121c849859f53cbfc40107a10, user_id=4ad4cc050d8645a6a70a06e4a3df8f89, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.694410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.708131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 541/1081] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:04:25 2022] PUT /identity/v3/projects/df47920121c849859f53cbfc40107a10/users/4ad4cc050d8645a6a70a06e4a3df8f89/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:04:25.718962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.719782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.720064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.720337 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.728617 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.730123 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:04:25.746384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:25.747487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:25.753666 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 541/1082] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:25.754326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:25.795768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:25.869301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd013436-3d8b-4bc0-97f2-ffec4ac2e1f5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:25.907533 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:25.908193 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:25.908474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:25.908747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:25.909525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:25.909831 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:25.911298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28e52-9b25-4179-a62a-3bd86c071711 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:25.924477 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 542/1083] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:25.930949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:26.030023 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749563c-0558-4897-820d-55efa942b6e9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:26.056759 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:26.066212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4675128-ac4d-43b7-8914-f42bd167b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:26.067096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675128-ac4d-43b7-8914-f42bd167b32a None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:26.067375 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675128-ac4d-43b7-8914-f42bd167b32a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:26.067647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675128-ac4d-43b7-8914-f42bd167b32a None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/10ba53ef4d604f33aa31e50d053f3641/roles/f22d5e97800e4e7abed01365fe86e06c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:26.070903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4675128-ac4d-43b7-8914-f42bd167b32a None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=10ba53ef4d604f33aa31e50d053f3641, role_id=f22d5e97800e4e7abed01365fe86e06c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:26.072332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4675128-ac4d-43b7-8914-f42bd167b32a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:26.084738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 542/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:04:25 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/10ba53ef4d604f33aa31e50d053f3641/roles/f22d5e97800e4e7abed01365fe86e06c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:04:27.883328 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295952-608d-47c0-aa30-af48badc2ae3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:27.883887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295952-608d-47c0-aa30-af48badc2ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:27.883887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13295952-608d-47c0-aa30-af48badc2ae3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:27.885245 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 543/1085] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:27.890641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269949-5729-435d-b693-6d5de70a25bc None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:27.891046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269949-5729-435d-b693-6d5de70a25bc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:27.891275 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269949-5729-435d-b693-6d5de70a25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:27.907532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-48269949-5729-435d-b693-6d5de70a25bc None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:27.908693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-48269949-5729-435d-b693-6d5de70a25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:27.974682 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 543/1086] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:27.998606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295952-608d-47c0-aa30-af48badc2ae3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.096058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.105448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13295952-608d-47c0-aa30-af48badc2ae3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.138736 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9dfd-a3b7-4249-ab4a-230e7c45280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.139524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9dfd-a3b7-4249-ab4a-230e7c45280d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.139803 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9dfd-a3b7-4249-ab4a-230e7c45280d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.140072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9dfd-a3b7-4249-ab4a-230e7c45280d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.150702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc9dfd-a3b7-4249-ab4a-230e7c45280d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-eddc9dfd-a3b7-4249-ab4a-230e7c45280d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:28.158226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:28.159261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:28.160101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 544/1087] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:28.165954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48269949-5729-435d-b693-6d5de70a25bc None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.261866 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48269949-5729-435d-b693-6d5de70a25bc None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.269531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc713-c9c4-41ae-9189-b48d7627fccb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.269823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc713-c9c4-41ae-9189-b48d7627fccb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.270152 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdc713-c9c4-41ae-9189-b48d7627fccb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.271512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 545/1088] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:04:28.277115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.277407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.277690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.279057 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.295924 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:28.297110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:28.298256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.298928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.299214 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.299490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.300238 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:28.300550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:28.301933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:28.310237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 544/1089] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:28.315832 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.366120 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 546/1090] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:04:28.389316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.415532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024111a4-7f5a-456f-ac91-0e07286a2da0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.450332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.451200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.451479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.451752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] PATH_INFO: `/v3/users/4ad4cc050d8645a6a70a06e4a3df8f89` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.452953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad4cc050d8645a6a70a06e4a3df8f89)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:28.454426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:28.456032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 545/1091] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/users/4ad4cc050d8645a6a70a06e4a3df8f89 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:28.462298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.479190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.495826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9d50-6375-4235-a9ad-ba10ec7ded98 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.508092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.533897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.534967 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.535256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.535611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.546409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:28.554779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:28.555754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:28.556853 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 547/1092] 10.222.0.30 () {56 vars in 1120 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:28.561862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.569300 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a330b-e4e1-45dc-b794-eb8cc8705515 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.605715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.606395 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.606680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.606952 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.661711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926724bc-06b5-41b5-9c2a-eb0e4441764a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.674284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:28.675742 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:28.695720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.696384 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.696668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.696955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.697685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:28.698027 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:28.699397 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:28.707544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 548/1093] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:28.713637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.721738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.724854 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.777220 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 546/1094] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:04:28.782798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.816689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3662d-a3a8-432a-ae8b-f68f36e46a54 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.851408 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.852212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.852496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.852775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.863594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:28.865058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:28.881123 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c96720-d978-479b-b9a0-105bbeedbcf8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:28.884394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:28.885595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:28.886539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:28.886539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:28.886539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:28.886539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:28.886539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 549/1095] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:28.891361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.916256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:28.917050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:28.917331 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:28.917610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:28.918830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] RBAC: Authorizing `identity:get_project(project_id=df47920121c849859f53cbfc40107a10)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:28.920516 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:28.922246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 547/1096] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/projects/df47920121c849859f53cbfc40107a10 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:28.928021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:28.943015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.954360 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:28.996508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c32b5-651b-4e5b-9f7e-22af490b3363 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:29.028951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61547d90-cf02-4970-ba3e-370dbd220d86 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:29.029758 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:29.030454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:29.030739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:29.031020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:29.031747 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:29.032055 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:29.033463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:29.045653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 550/1097] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:29.051179 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:29.065147 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:29.065797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:29.066110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:29.066382 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:29.067204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=df47920121c849859f53cbfc40107a10, user.id=4ad4cc050d8645a6a70a06e4a3df8f89) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:29.067510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:29.068934 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:29.076120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 548/1098] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:28 2022] GET /identity/v3/role_assignments?user.id=4ad4cc050d8645a6a70a06e4a3df8f89&scope.project.id=df47920121c849859f53cbfc40107a10&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:04:29.158694 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd9066-8bd0-4c97-b6bb-93e8915a99eb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:29.182717 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:29.201255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:29.202091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:29.202377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:29.202652 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:29.210868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:29.212353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:04:29.228478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:29.229596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:29.230752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 551/1099] 10.222.0.30 () {56 vars in 1093 bytes} [Tue May 24 09:04:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:04:29.235667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:29.318062 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:29.339473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7c7b9-f5e3-45f6-8468-fca4613ebf18 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:29.372683 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:29.373344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:29.373624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:29.373896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:29.374745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:29.375052 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:29.376470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:29.395356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 549/1100] 10.222.0.30 () {56 vars in 1133 bytes} [Tue May 24 09:04:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:29.401807 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:29.502277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c073f-d422-42e5-abe4-a6ede061e61b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:29.535391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:29.536036 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:29.536317 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:29.536590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:29.581762 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:29.604556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:29.606073 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:29.705260 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 552/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:29.711382 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:29.816825 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa693d-afca-4ca6-bcb8-6f485b12e701 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:29.851761 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:29.852553 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:29.852830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:29.853097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:29.855702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:29.863646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:29.865109 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:29.883379 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:29.884433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:29.889872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:04:29.889872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:29.889872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:04:29.889872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:29.889872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 550/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:29.890332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:29.967795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:29.989953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc58186-b363-46c8-b717-4268af01784c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:30.023932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:30.024595 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:30.024876 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:30.025149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:30.025864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:30.026194 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:30.027574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:30.039779 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 553/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:30.045787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:30.144538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee600c-b615-40ce-a0d4-2050a7b5f329 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:30.178476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:30.180392 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:30.180675 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:30.180946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:30.187385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:30.188807 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:04:30.202808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:30.203755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:30.204643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 551/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:30.210327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:30.312688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7c20b-5ec3-4807-a797-95d4c3627391 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:30.346308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:30.346958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:30.347239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:30.347512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:30.348282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:30.348589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:30.350419 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede39ad-1dc9-4b90-9ee5-a4e87e37b13a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:30.358375 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:30.364483 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 554/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:30.370545 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:30.419539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:30.470600 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372427c-8a7d-4327-aefb-f83eacea75fb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:30.502700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:30.503344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:30.503624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:30.503897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:30.504711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] RBAC: Adding query filter params (role.id=f22d5e97800e4e7abed01365fe86e06c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=10ba53ef4d604f33aa31e50d053f3641) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:30.505021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:30.506483 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e07386-86c0-4028-869d-42b04162f207 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:30.512501 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 552/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:30 2022] GET /identity/v3/role_assignments?user.id=10ba53ef4d604f33aa31e50d053f3641&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=f22d5e97800e4e7abed01365fe86e06c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:31.310824 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1bbe0-9c9f-430a-955f-a7dbe8b5c496 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:31.311365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1bbe0-9c9f-430a-955f-a7dbe8b5c496 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:31.311365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1bbe0-9c9f-430a-955f-a7dbe8b5c496 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:31.312716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 555/1107] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:31.318180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:31.318624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:31.318727 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:31.337708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:31.339021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:31.404710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 553/1108] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:31.429834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1bbe0-9c9f-430a-955f-a7dbe8b5c496 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:31.529606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1bbe0-9c9f-430a-955f-a7dbe8b5c496 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:31.562774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810eba9c-ba1b-4167-ac24-ad57d35730a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:31.563494 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eba9c-ba1b-4167-ac24-ad57d35730a7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:31.563777 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eba9c-ba1b-4167-ac24-ad57d35730a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:31.564052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810eba9c-ba1b-4167-ac24-ad57d35730a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:31.565220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810eba9c-ba1b-4167-ac24-ad57d35730a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:31.566680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810eba9c-ba1b-4167-ac24-ad57d35730a7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:31.568292 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 556/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:31.574663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:31.616448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:31.671513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13cd84-807a-4738-a8f9-ea63f4035d76 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:31.704317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7dd4e-6e3a-452c-940a-44d27e972c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:31.704979 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7dd4e-6e3a-452c-940a-44d27e972c1d None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:31.705266 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7dd4e-6e3a-452c-940a-44d27e972c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:31.705542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7dd4e-6e3a-452c-940a-44d27e972c1d None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:31.706273 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7dd4e-6e3a-452c-940a-44d27e972c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:31.707708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7dd4e-6e3a-452c-940a-44d27e972c1d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:31.727341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 554/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:04:31 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:33.926897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeca8e-a1db-4b8e-a064-7fefc80f9a56 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:33.927416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeca8e-a1db-4b8e-a064-7fefc80f9a56 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:33.927509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeca8e-a1db-4b8e-a064-7fefc80f9a56 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:33.929011 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 557/1111] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:33.934427 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:33.934828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:33.934986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:33.952786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:33.953998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:34.018741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 555/1112] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:34.042407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeca8e-a1db-4b8e-a064-7fefc80f9a56 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:34.107880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:34.144530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeca8e-a1db-4b8e-a064-7fefc80f9a56 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:34.177590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:34.178958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:34.179358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:34.179640 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] PATH_INFO: `/v3/roles/404a4769ebb543319b7a918411953668` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:34.181113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] RBAC: Authorizing `identity:get_role(role_id=404a4769ebb543319b7a918411953668)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:34.182520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:34.183858 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 558/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:34 2022] GET /identity/v3/roles/404a4769ebb543319b7a918411953668 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:34.189710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:34.216936 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:34.286699 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1981-635c-4c9d-9f1b-b60c973b8c03 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:34.321493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:34.322326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:34.322608 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:34.322876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] PATH_INFO: `/v3/users/edb88fb322c1420281b364f453a37934` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:34.335641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] RBAC: Authorizing `identity:get_user(user_id=edb88fb322c1420281b364f453a37934)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:34.337072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:34.338711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 556/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:34 2022] GET /identity/v3/users/edb88fb322c1420281b364f453a37934 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:34.344350 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:34.441873 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df8258-6cab-4817-90fd-8c14d9e49a5c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:34.477386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:34.478050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:34.478337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:34.478612 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:34.481227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:34.546958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:34.548412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:34.643411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 559/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:34.649951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:34.732165 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:34.746739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610edce-348f-47ff-acbc-293df0dd8207 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:34.780194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ee0d6-c2af-4c97-8b52-2084a84bbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:34.781040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ee0d6-c2af-4c97-8b52-2084a84bbf2f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:34.781324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ee0d6-c2af-4c97-8b52-2084a84bbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:34.781599 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ee0d6-c2af-4c97-8b52-2084a84bbf2f None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:34.782789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ee0d6-c2af-4c97-8b52-2084a84bbf2f None admin] RBAC: Authorizing `identity:get_project(project_id=df47920121c849859f53cbfc40107a10)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:34.784216 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ee0d6-c2af-4c97-8b52-2084a84bbf2f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:34.785860 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 557/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:34 2022] GET /identity/v3/projects/df47920121c849859f53cbfc40107a10 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:34.792429 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:34.825787 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:34.891101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b381e-b589-4ae9-938c-394707013242 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:34.924218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:34.924867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:34.925154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:34.925435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:34.926281 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] RBAC: Adding query filter params (role.id=404a4769ebb543319b7a918411953668, scope.project.id=df47920121c849859f53cbfc40107a10, user.id=edb88fb322c1420281b364f453a37934) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:34.926596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:34.928029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1bad-2aa1-45e4-aedd-f0018ae0f578 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:34.934158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 560/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:34 2022] GET /identity/v3/role_assignments?user.id=edb88fb322c1420281b364f453a37934&scope.project.id=df47920121c849859f53cbfc40107a10&role.id=404a4769ebb543319b7a918411953668 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:37.076175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb01c1-9762-4882-9ec1-e29fb7ad1b17 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:37.076678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb01c1-9762-4882-9ec1-e29fb7ad1b17 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:37.076678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb01c1-9762-4882-9ec1-e29fb7ad1b17 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:37.078011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 558/1118] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:37.083218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:37.083637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:37.083785 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:37.100975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:37.102204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:37.167487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 561/1119] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:37.190157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb01c1-9762-4882-9ec1-e29fb7ad1b17 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:37.288719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb01c1-9762-4882-9ec1-e29fb7ad1b17 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:37.322500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:37.323332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:37.323616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:37.323892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] PATH_INFO: `/v3/roles/404a4769ebb543319b7a918411953668` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:37.325349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] RBAC: Authorizing `identity:get_role(role_id=404a4769ebb543319b7a918411953668)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:37.326794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:37.328078 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 559/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:37 2022] GET /identity/v3/roles/404a4769ebb543319b7a918411953668 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:37.333612 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:37.360157 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:37.430789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9216a-844e-4284-9bf2-f9f9cb740247 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:37.463567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:37.464430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:37.464715 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:37.464996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] PATH_INFO: `/v3/users/edb88fb322c1420281b364f453a37934` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:37.466205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] RBAC: Authorizing `identity:get_user(user_id=edb88fb322c1420281b364f453a37934)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:37.467651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:37.469291 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 562/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:37 2022] GET /identity/v3/users/edb88fb322c1420281b364f453a37934 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:37.474910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:37.500473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:37.575046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cede8-0761-40fb-9f39-2d4b3172bae0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:37.607730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2b7a-64f8-46dd-83bc-c2962b324d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:37.608515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2b7a-64f8-46dd-83bc-c2962b324d64 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:37.608797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2b7a-64f8-46dd-83bc-c2962b324d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:37.609071 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2b7a-64f8-46dd-83bc-c2962b324d64 None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:37.610263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d2b7a-64f8-46dd-83bc-c2962b324d64 None admin] RBAC: Authorizing `identity:get_project(project_id=df47920121c849859f53cbfc40107a10)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:37.611685 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d2b7a-64f8-46dd-83bc-c2962b324d64 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:37.613349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 560/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:37 2022] GET /identity/v3/projects/df47920121c849859f53cbfc40107a10 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:37.619962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:37.711811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:37.718024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5651-a54f-448b-8b8d-cf61c23b8b07 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:37.751734 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b4a31-25fb-479a-b15d-8079ed95c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:37.752615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b4a31-25fb-479a-b15d-8079ed95c1ac None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:37.752900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b4a31-25fb-479a-b15d-8079ed95c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:37.753176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b4a31-25fb-479a-b15d-8079ed95c1ac None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10/users/edb88fb322c1420281b364f453a37934/roles/404a4769ebb543319b7a918411953668` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:37.755386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b4a31-25fb-479a-b15d-8079ed95c1ac None admin] RBAC: Authorizing `identity:create_grant(project_id=df47920121c849859f53cbfc40107a10, user_id=edb88fb322c1420281b364f453a37934, role_id=404a4769ebb543319b7a918411953668)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:37.757046 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b4a31-25fb-479a-b15d-8079ed95c1ac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:37.769241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 563/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:04:37 2022] PUT /identity/v3/projects/df47920121c849859f53cbfc40107a10/users/edb88fb322c1420281b364f453a37934/roles/404a4769ebb543319b7a918411953668 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:04:39.917815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acae6f-d305-4a0b-aaed-8b81a55f55d6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:39.918350 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acae6f-d305-4a0b-aaed-8b81a55f55d6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:39.918466 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acae6f-d305-4a0b-aaed-8b81a55f55d6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:39.919733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 561/1124] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:39.925312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:39.925705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:39.925872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:39.942988 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:39.944719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:40.009250 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 564/1125] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:40.032756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acae6f-d305-4a0b-aaed-8b81a55f55d6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:40.122278 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:40.133249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acae6f-d305-4a0b-aaed-8b81a55f55d6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:40.167789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:40.168619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:40.168896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:40.169162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] PATH_INFO: `/v3/roles/404a4769ebb543319b7a918411953668` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:40.170884 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] RBAC: Authorizing `identity:get_role(role_id=404a4769ebb543319b7a918411953668)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:40.172243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:40.173561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 562/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:40 2022] GET /identity/v3/roles/404a4769ebb543319b7a918411953668 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:40.179489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:40.261809 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:40.277458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564af2d7-1d38-43ef-b535-d170d1c82bea None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:40.311511 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:40.312369 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:40.312646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:40.312917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] PATH_INFO: `/v3/users/edb88fb322c1420281b364f453a37934` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:40.314115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] RBAC: Authorizing `identity:get_user(user_id=edb88fb322c1420281b364f453a37934)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:40.315581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:40.317190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 565/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:40 2022] GET /identity/v3/users/edb88fb322c1420281b364f453a37934 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:40.323584 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:40.420514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574908c8-0ac4-4920-a0c3-d3b41b5ef979 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:40.454076 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:40.454708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:40.454989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:40.455263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:40.486209 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:40.527219 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:40.528656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:40.630373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 563/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:40.636412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:40.733583 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f17bc-f144-438a-973a-1fc743e5fe10 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:40.767140 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c77f2-bca0-4094-b931-5f2097c7255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:40.767990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c77f2-bca0-4094-b931-5f2097c7255e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:40.768272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c77f2-bca0-4094-b931-5f2097c7255e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:40.768547 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c77f2-bca0-4094-b931-5f2097c7255e None admin] PATH_INFO: `/v3/projects/df47920121c849859f53cbfc40107a10` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:40.769722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c77f2-bca0-4094-b931-5f2097c7255e None admin] RBAC: Authorizing `identity:get_project(project_id=df47920121c849859f53cbfc40107a10)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:40.771186 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c77f2-bca0-4094-b931-5f2097c7255e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:40.773453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 566/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:40 2022] GET /identity/v3/projects/df47920121c849859f53cbfc40107a10 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:40.779351 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:40.836939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:40.877142 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef637536-e9d9-429e-9604-5d81f4910858 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:40.910184 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:40.910831 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:40.911115 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:40.911392 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:40.912225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] RBAC: Adding query filter params (role.id=404a4769ebb543319b7a918411953668, scope.project.id=df47920121c849859f53cbfc40107a10, user.id=edb88fb322c1420281b364f453a37934) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:40.912538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:40.914103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f6c0a-afae-4e5b-a2aa-c45cb3681ca1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:40.919771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 564/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:40 2022] GET /identity/v3/role_assignments?user.id=edb88fb322c1420281b364f453a37934&scope.project.id=df47920121c849859f53cbfc40107a10&role.id=404a4769ebb543319b7a918411953668 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:43.107567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19967c1-4257-404c-a2aa-16f5f7e29457 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:43.108174 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19967c1-4257-404c-a2aa-16f5f7e29457 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:43.108174 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19967c1-4257-404c-a2aa-16f5f7e29457 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:43.109409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 567/1131] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:43.114493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:43.114928 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:43.115063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:43.132937 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:43.134137 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:43.199096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 565/1132] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:43.221295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19967c1-4257-404c-a2aa-16f5f7e29457 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:43.245566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:43.320741 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19967c1-4257-404c-a2aa-16f5f7e29457 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:43.353190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81c2ec-af2b-452e-b499-870377593125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:43.353982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c2ec-af2b-452e-b499-870377593125 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:43.354266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c2ec-af2b-452e-b499-870377593125 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:43.354541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81c2ec-af2b-452e-b499-870377593125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:43.355692 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81c2ec-af2b-452e-b499-870377593125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:43.357108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81c2ec-af2b-452e-b499-870377593125 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:43.358755 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 568/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:43.364407 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:43.415520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:43.462200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a888d9-bd5d-46b3-9ce1-d49b850836a9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:43.495981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ee272-ad25-48fd-8acc-f015175cbe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:43.496626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee272-ad25-48fd-8acc-f015175cbe58 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:43.496913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee272-ad25-48fd-8acc-f015175cbe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:43.497190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ee272-ad25-48fd-8acc-f015175cbe58 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:43.497892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ee272-ad25-48fd-8acc-f015175cbe58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:43.499361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ee272-ad25-48fd-8acc-f015175cbe58 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:43.523581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 566/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:04:43 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:45.772968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39a210-c3b2-4de3-84c1-c8ef70b73d31 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:45.773508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39a210-c3b2-4de3-84c1-c8ef70b73d31 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:45.773508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39a210-c3b2-4de3-84c1-c8ef70b73d31 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:45.774928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 569/1135] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:45.780017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:45.780405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:45.780574 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:45.798673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:45.799841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:45.865390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 567/1136] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:45.890164 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39a210-c3b2-4de3-84c1-c8ef70b73d31 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:45.980223 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:45.990346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39a210-c3b2-4de3-84c1-c8ef70b73d31 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:46.023099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b32ad-7a7b-453f-bbd1-914c4509205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:46.023818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b32ad-7a7b-453f-bbd1-914c4509205c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:46.024103 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b32ad-7a7b-453f-bbd1-914c4509205c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:46.024378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b32ad-7a7b-453f-bbd1-914c4509205c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:46.025533 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b32ad-7a7b-453f-bbd1-914c4509205c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:46.027032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b32ad-7a7b-453f-bbd1-914c4509205c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:46.028619 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 570/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:04:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:46.034194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:46.067968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:46.132355 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdabc21-01bb-4432-be5c-3ef80ac1869f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:46.165716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364aa70-8a74-4580-9c2e-faf94012c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:46.166399 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364aa70-8a74-4580-9c2e-faf94012c3cf None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:46.166684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364aa70-8a74-4580-9c2e-faf94012c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:46.166964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364aa70-8a74-4580-9c2e-faf94012c3cf None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:46.167665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364aa70-8a74-4580-9c2e-faf94012c3cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:46.169091 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364aa70-8a74-4580-9c2e-faf94012c3cf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:46.188260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 568/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:04:46 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:04:48.379185 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039c00-0dec-4f8d-b6f4-983ecfbdc090 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:48.379744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039c00-0dec-4f8d-b6f4-983ecfbdc090 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:48.379744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039c00-0dec-4f8d-b6f4-983ecfbdc090 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:48.381169 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 571/1139] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:48.386541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:48.386938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:48.387103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:48.404107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:48.405295 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:48.471117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 569/1140] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:48.495312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039c00-0dec-4f8d-b6f4-983ecfbdc090 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:48.593802 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039c00-0dec-4f8d-b6f4-983ecfbdc090 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:48.627738 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:48.628513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:48.628792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:48.629065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:48.639084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:48.646484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:48.648272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:48.649432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 572/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:48.654150 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:48.675263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:48.750262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99842dc-1eeb-4d39-b80d-89e8b387ebfc None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:48.783264 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:48.783916 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:48.784197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:48.784470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:48.785203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:48.785508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:48.786917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:48.795419 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 570/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:48.801050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:48.821507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:48.901807 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8848c1-a7b5-435e-8495-484b04e5cb0a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:48.934494 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:48.935348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:48.935627 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:48.935900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] PATH_INFO: `/v3/users/200fd1d5c31a44e6aeaddc6a02e40cd6` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:48.949667 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] RBAC: Authorizing `identity:get_user(user_id=200fd1d5c31a44e6aeaddc6a02e40cd6)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:48.951126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:48.952735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 573/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:48 2022] GET /identity/v3/users/200fd1d5c31a44e6aeaddc6a02e40cd6 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:48.958460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:49.039134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:49.056989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702e154-4965-45bc-ae5f-eb3b6c6a3b6e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:49.090128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:49.090765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:49.091048 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:49.091321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:49.155854 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:49.157237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:49.234496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:49.253362 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 571/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:49.259929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:49.334150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:49.356870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c8ce6-041d-4500-903c-a69e0b9fe58b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:49.390272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98246-250d-4af3-8e3a-4c3baba77da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:49.391118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98246-250d-4af3-8e3a-4c3baba77da8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:49.391401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98246-250d-4af3-8e3a-4c3baba77da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:49.391676 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98246-250d-4af3-8e3a-4c3baba77da8 None admin] PATH_INFO: `/v3/projects/361557ccb974426eb914d014b0508fb9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:49.392831 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98246-250d-4af3-8e3a-4c3baba77da8 None admin] RBAC: Authorizing `identity:get_project(project_id=361557ccb974426eb914d014b0508fb9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:49.394285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d98246-250d-4af3-8e3a-4c3baba77da8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:49.395941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 574/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:49 2022] GET /identity/v3/projects/361557ccb974426eb914d014b0508fb9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:49.402436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:49.499096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8204f-4ef0-4904-8799-2c0667c9d3e5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:49.532606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:49.533249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:49.533535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:49.533811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:49.534694 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=361557ccb974426eb914d014b0508fb9, user.id=200fd1d5c31a44e6aeaddc6a02e40cd6) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:49.535007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:49.536440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09208f4-d98f-4502-9201-fe049349c851 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:49.541818 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 572/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:49 2022] GET /identity/v3/role_assignments?user.id=200fd1d5c31a44e6aeaddc6a02e40cd6&scope.project.id=361557ccb974426eb914d014b0508fb9&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:51.689864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf2a5-5a95-4d7a-8831-2d3e480d7c79 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:51.690401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf2a5-5a95-4d7a-8831-2d3e480d7c79 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:51.690519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf2a5-5a95-4d7a-8831-2d3e480d7c79 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:51.691818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 575/1147] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:51.697669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:51.698076 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:51.698256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:51.714942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:51.716111 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:51.758364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:51.782474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 573/1148] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:51.806975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcf2a5-5a95-4d7a-8831-2d3e480d7c79 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:51.905037 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fcf2a5-5a95-4d7a-8831-2d3e480d7c79 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:51.938891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:51.939671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:51.940004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:51.940229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:51.950239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:51.957759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:51.958867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:51.959795 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 576/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:51.964804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:52.061961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db3b0b-3771-44d5-bdc8-dfa623add07c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:52.094771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:52.095424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:52.095709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:52.095987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:52.096723 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:52.097033 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:52.098440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:52.106792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 574/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:52.112399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:52.116351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:52.210460 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49f9aa-0817-4f24-921c-5242a4f00a3b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:52.242848 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:52.243701 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:52.243984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:52.244263 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] PATH_INFO: `/v3/users/200fd1d5c31a44e6aeaddc6a02e40cd6` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:52.245445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] RBAC: Authorizing `identity:get_user(user_id=200fd1d5c31a44e6aeaddc6a02e40cd6)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:52.246897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:52.248490 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 577/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:52 2022] GET /identity/v3/users/200fd1d5c31a44e6aeaddc6a02e40cd6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:52.254231 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:52.294011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:52.352669 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6404-363d-41fc-96db-4a515b9c461c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:52.386180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1416bc-fe2b-42da-9521-510a9813bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:52.387030 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1416bc-fe2b-42da-9521-510a9813bfbf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:52.387314 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1416bc-fe2b-42da-9521-510a9813bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:52.387589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1416bc-fe2b-42da-9521-510a9813bfbf None admin] PATH_INFO: `/v3/projects/361557ccb974426eb914d014b0508fb9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:52.388748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1416bc-fe2b-42da-9521-510a9813bfbf None admin] RBAC: Authorizing `identity:get_project(project_id=361557ccb974426eb914d014b0508fb9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:52.390197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1416bc-fe2b-42da-9521-510a9813bfbf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:52.391858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 575/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:52 2022] GET /identity/v3/projects/361557ccb974426eb914d014b0508fb9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:52.398114 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:52.469222 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:52.498905 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf74d2d-edd0-4f4a-9fe2-a87b835ffade None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:52.531320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ff35a-9972-44f7-a88b-aac69304d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:52.532204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ff35a-9972-44f7-a88b-aac69304d9c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:52.532507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ff35a-9972-44f7-a88b-aac69304d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:52.532780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ff35a-9972-44f7-a88b-aac69304d9c0 None admin] PATH_INFO: `/v3/projects/361557ccb974426eb914d014b0508fb9/users/200fd1d5c31a44e6aeaddc6a02e40cd6/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:52.534746 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ff35a-9972-44f7-a88b-aac69304d9c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=361557ccb974426eb914d014b0508fb9, user_id=200fd1d5c31a44e6aeaddc6a02e40cd6, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:52.536203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ff35a-9972-44f7-a88b-aac69304d9c0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:52.549669 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 578/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:04:52 2022] PUT /identity/v3/projects/361557ccb974426eb914d014b0508fb9/users/200fd1d5c31a44e6aeaddc6a02e40cd6/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:04:54.698360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820f35-7eca-4bbc-9f39-2c3b7ecdc9b4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:54.698999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820f35-7eca-4bbc-9f39-2c3b7ecdc9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:54.698999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29820f35-7eca-4bbc-9f39-2c3b7ecdc9b4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:54.700250 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 576/1154] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:54.705346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:54.705770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:54.705899 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:54.723029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:54.724198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:54.788920 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 579/1155] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:54.812821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820f35-7eca-4bbc-9f39-2c3b7ecdc9b4 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:54.910962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29820f35-7eca-4bbc-9f39-2c3b7ecdc9b4 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:54.918507 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:54.946923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:54.947740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:54.948022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:54.948293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:54.957976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:04:54.965647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:54.966847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:04:54.967953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 577/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:54.972784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:55.031581 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:55.071466 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f509-3f40-4c1d-b879-2ba8d75df097 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:55.104918 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:55.105575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:55.105856 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:55.106156 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:55.106895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:55.107202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:55.108580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:55.116484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 580/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:55.122100 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:55.219403 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2d5c-992c-466e-b81f-2915f1e7b58f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:55.252044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:55.252889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:55.253171 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:55.253443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] PATH_INFO: `/v3/users/200fd1d5c31a44e6aeaddc6a02e40cd6` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:55.254627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] RBAC: Authorizing `identity:get_user(user_id=200fd1d5c31a44e6aeaddc6a02e40cd6)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:55.256656 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:55.258359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 578/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:04:55 2022] GET /identity/v3/users/200fd1d5c31a44e6aeaddc6a02e40cd6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:55.263850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:55.359744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb884e2a-a7b5-4420-bb1b-40d655188f74 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:55.382665 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:55.393104 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:55.393739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:55.394059 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:55.394338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:55.459447 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:55.460887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:55.556626 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 581/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:55.562366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:55.596254 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:55.661305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013eeef-4e3e-4095-a2cb-1d49645ebf4c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:55.695123 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ca35b-58fd-4145-a0f4-4d5c603d0e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:55.695975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca35b-58fd-4145-a0f4-4d5c603d0e72 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:55.696260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca35b-58fd-4145-a0f4-4d5c603d0e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:55.696535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ca35b-58fd-4145-a0f4-4d5c603d0e72 None admin] PATH_INFO: `/v3/projects/361557ccb974426eb914d014b0508fb9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:55.697707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ca35b-58fd-4145-a0f4-4d5c603d0e72 None admin] RBAC: Authorizing `identity:get_project(project_id=361557ccb974426eb914d014b0508fb9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:55.699180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ca35b-58fd-4145-a0f4-4d5c603d0e72 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:55.700856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 579/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:04:55 2022] GET /identity/v3/projects/361557ccb974426eb914d014b0508fb9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:55.706895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:55.731668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:55.805923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103582-7f10-43ee-8a4b-6882981f42cb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:55.839125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:55.839713 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:55.839998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:55.840278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:55.841096 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=361557ccb974426eb914d014b0508fb9, user.id=200fd1d5c31a44e6aeaddc6a02e40cd6) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:55.841413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:55.842863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c8a13-a1b6-4c01-8dd9-79ae1bbd1558 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:55.848557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 582/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:04:55 2022] GET /identity/v3/role_assignments?user.id=200fd1d5c31a44e6aeaddc6a02e40cd6&scope.project.id=361557ccb974426eb914d014b0508fb9&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:04:58.031291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab658-22de-4808-b0ac-58bba906bd59 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:58.031855 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab658-22de-4808-b0ac-58bba906bd59 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:58.031855 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ab658-22de-4808-b0ac-58bba906bd59 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:58.033201 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 580/1162] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:04:58.038804 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:58.039206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:58.039353 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:58.057446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:04:58.058575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:04:58.124063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 583/1163] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:04:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:04:58.146787 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ab658-22de-4808-b0ac-58bba906bd59 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:58.246982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ab658-22de-4808-b0ac-58bba906bd59 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:58.248468 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:58.281063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:58.281703 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:58.282015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:58.282294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:58.347156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:58.348538 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:58.444563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 581/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:04:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:04:58.450563 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:58.468379 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:58.549147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74907dd4-97f2-494d-918c-1f82ba334272 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:58.582288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:58.583084 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:58.583367 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:58.583641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:58.590533 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:58.591980 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a3ef5222-9e15-4563-b327-5868f2ae5eba None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:04:58.606448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:04:58.607629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:04:58.608698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 584/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:04:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:04:58.613716 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:04:58.616912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:04:58.716443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d850-fe03-4fc0-a4de-3b0ef1ec74e6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:04:58.750237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:04:58.750891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:04:58.751174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:04:58.751448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:04:58.752155 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:04:58.752459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:04:58.753813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799c70-c985-4b02-8447-8480da06d013 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:04:58.761208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 582/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue May 24 09:04:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:00.928288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bbcba-6ac7-467a-8840-f040f822504e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:00.928288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bbcba-6ac7-467a-8840-f040f822504e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:00.928288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bbcba-6ac7-467a-8840-f040f822504e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:00.928288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 585/1167] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:05:00.933706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166058ea-18f4-4863-9521-97810418ed65 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:00.934149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166058ea-18f4-4863-9521-97810418ed65 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:00.934317 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166058ea-18f4-4863-9521-97810418ed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:00.952207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-166058ea-18f4-4863-9521-97810418ed65 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:05:00.953447 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-166058ea-18f4-4863-9521-97810418ed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:05:01.013650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:01.022180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 583/1168] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:05:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:05:01.044452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bbcba-6ac7-467a-8840-f040f822504e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:01.127181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:01.150498 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bbcba-6ac7-467a-8840-f040f822504e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:01.183485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fedc07-db3a-4732-8924-bd1e87cd9431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:01.184135 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fedc07-db3a-4732-8924-bd1e87cd9431 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:01.184416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fedc07-db3a-4732-8924-bd1e87cd9431 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:01.184690 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fedc07-db3a-4732-8924-bd1e87cd9431 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:01.185436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fedc07-db3a-4732-8924-bd1e87cd9431 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:01.186831 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fedc07-db3a-4732-8924-bd1e87cd9431 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:01.201283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 586/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue May 24 09:05:01 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:05:03.431665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a24a5c-1286-4621-9c2a-bef435d3d521 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:03.432203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a24a5c-1286-4621-9c2a-bef435d3d521 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:03.432203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a24a5c-1286-4621-9c2a-bef435d3d521 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:03.433567 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 584/1170] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:05:03.438823 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:03.439199 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:03.439386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:03.455891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:05:03.457068 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:05:03.521897 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 587/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:05:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:05:03.545456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a24a5c-1286-4621-9c2a-bef435d3d521 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:03.643531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a24a5c-1286-4621-9c2a-bef435d3d521 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:03.676531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc7419-9e7b-4f06-a4fe-89449508f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:03.677389 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7419-9e7b-4f06-a4fe-89449508f954 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:03.677749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7419-9e7b-4f06-a4fe-89449508f954 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:03.678143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7419-9e7b-4f06-a4fe-89449508f954 None admin] PATH_INFO: `/v3/domains/aeac93dc41024eddade16081b83a6f0f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:03.688114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc7419-9e7b-4f06-a4fe-89449508f954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aeac93dc41024eddade16081b83a6f0f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:03.689496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc7419-9e7b-4f06-a4fe-89449508f954 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:03.691174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 585/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue May 24 09:05:03 2022] GET /identity/v3/domains/aeac93dc41024eddade16081b83a6f0f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:03.697376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:03.761657 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:03.796307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4492-b304-4e91-a1c7-f155befbf322 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:03.829241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405437d-6ab2-49cb-88d9-b8728fc4a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:03.829892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405437d-6ab2-49cb-88d9-b8728fc4a001 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:03.830204 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405437d-6ab2-49cb-88d9-b8728fc4a001 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:03.830478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405437d-6ab2-49cb-88d9-b8728fc4a001 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:03.831175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405437d-6ab2-49cb-88d9-b8728fc4a001 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:03.832604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405437d-6ab2-49cb-88d9-b8728fc4a001 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:03.857870 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 588/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:05:03 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:05:06.055580 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0cc2-2bdb-4bc4-92a8-056ef536ecb1 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:06.056106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0cc2-2bdb-4bc4-92a8-056ef536ecb1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:06.056106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa0cc2-2bdb-4bc4-92a8-056ef536ecb1 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:06.057442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 586/1174] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:05:06.062645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:06.063072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:06.063217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:06.079761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:05:06.080955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:05:06.147577 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 589/1175] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:05:06.172715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0cc2-2bdb-4bc4-92a8-056ef536ecb1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:06.229840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:06.279003 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa0cc2-2bdb-4bc4-92a8-056ef536ecb1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:06.312650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae225-14fa-4a69-aab1-04e4a0a415a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:06.313440 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae225-14fa-4a69-aab1-04e4a0a415a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:06.313723 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae225-14fa-4a69-aab1-04e4a0a415a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:06.314027 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae225-14fa-4a69-aab1-04e4a0a415a3 None admin] PATH_INFO: `/v3/domains/aeac93dc41024eddade16081b83a6f0f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:06.315191 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae225-14fa-4a69-aab1-04e4a0a415a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aeac93dc41024eddade16081b83a6f0f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:06.316625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae225-14fa-4a69-aab1-04e4a0a415a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:06.318243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 587/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue May 24 09:05:06 2022] GET /identity/v3/domains/aeac93dc41024eddade16081b83a6f0f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:06.323892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:06.372780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:06.422448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c4866-6d09-4e0d-9d48-dbaee934dd88 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:06.455396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7054f-27e9-44ac-a212-8a61c1b1631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:06.456060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7054f-27e9-44ac-a212-8a61c1b1631e None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:06.456347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7054f-27e9-44ac-a212-8a61c1b1631e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:06.456625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7054f-27e9-44ac-a212-8a61c1b1631e None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:06.457337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7054f-27e9-44ac-a212-8a61c1b1631e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:06.459372 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7054f-27e9-44ac-a212-8a61c1b1631e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:06.479478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 590/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:05:06 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:05:08.714411 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291333-1a36-43b0-90bf-e1d4c6b7ef23 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:08.714945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291333-1a36-43b0-90bf-e1d4c6b7ef23 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:08.714945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291333-1a36-43b0-90bf-e1d4c6b7ef23 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:08.716339 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 588/1178] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:05:08.721566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:08.721990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:08.722168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:08.739348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:05:08.741230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:05:08.806385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 591/1179] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:05:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:05:08.828992 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291333-1a36-43b0-90bf-e1d4c6b7ef23 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:08.932520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291333-1a36-43b0-90bf-e1d4c6b7ef23 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:08.955217 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:08.966698 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:08.967412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:08.967692 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:08.967965 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:08.977830 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:05:08.985304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:05:08.986394 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:05:08.987432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 589/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:05:08.992580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:09.026696 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:09.090929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0c1dd-93bc-49c1-a441-d0da29aa501e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:09.126024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:09.126719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:09.127023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:09.127325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:09.128150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:05:09.128485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:09.130020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:09.138712 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 592/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:09.144316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:09.242346 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f993c-f267-4553-9dc8-cc03940bd20b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:09.274496 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:09.275342 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:09.275624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:09.275894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] PATH_INFO: `/v3/users/189f07cee42442b884fb7dd9fa688697` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:09.289161 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] RBAC: Authorizing `identity:get_user(user_id=189f07cee42442b884fb7dd9fa688697)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:09.290624 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:09.292230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 590/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:05:09 2022] GET /identity/v3/users/189f07cee42442b884fb7dd9fa688697 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:09.298346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:09.397603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:09.402235 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0edb-7196-4a07-bdde-99ab54eb4234 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:09.437302 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:09.438016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:09.438341 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:09.438620 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:09.505166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:09.507292 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:09.599862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:09.604307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 593/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:05:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:05:09.610050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:09.654182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:09.709294 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf49c8b-5d94-45cc-9c97-0f7c0be54e85 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:09.742429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8911d9-73ec-4756-81c2-39f0891f11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:09.743271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8911d9-73ec-4756-81c2-39f0891f11a9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:09.743552 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8911d9-73ec-4756-81c2-39f0891f11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:09.743829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8911d9-73ec-4756-81c2-39f0891f11a9 None admin] PATH_INFO: `/v3/projects/70647ef430834f12b5f9141701620791` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:09.744995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8911d9-73ec-4756-81c2-39f0891f11a9 None admin] RBAC: Authorizing `identity:get_project(project_id=70647ef430834f12b5f9141701620791)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:09.746460 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8911d9-73ec-4756-81c2-39f0891f11a9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:09.748127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 591/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:05:09 2022] GET /identity/v3/projects/70647ef430834f12b5f9141701620791 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:09.754168 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:09.852518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ce60-d01e-4b77-90b3-9106aa368399 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:09.885432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:09.886105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:09.886389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:09.886662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:09.887478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=70647ef430834f12b5f9141701620791, user.id=189f07cee42442b884fb7dd9fa688697) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:05:09.887791 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:09.889237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aed933-d850-4c48-8901-de366e3e4873 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:09.894568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 594/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:05:09 2022] GET /identity/v3/role_assignments?user.id=189f07cee42442b884fb7dd9fa688697&scope.project.id=70647ef430834f12b5f9141701620791&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:12.032177 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8130d-3657-4c63-8432-957ce1ee3927 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.032704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8130d-3657-4c63-8432-957ce1ee3927 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.032704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8130d-3657-4c63-8432-957ce1ee3927 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.034116 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 592/1186] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:05:12.040012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.040418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.040572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.058233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:05:12.059347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:05:12.113768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:12.125245 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 595/1187] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:05:12.147164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8130d-3657-4c63-8432-957ce1ee3927 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:12.245431 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8130d-3657-4c63-8432-957ce1ee3927 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:12.255808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:12.278876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:12.279657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.279940 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.280215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.290593 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:05:12.298446 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:05:12.299513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:05:12.300549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 593/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:05:12.306115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:12.402229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d68775-9061-4f1d-b7a4-509884f54313 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:12.435614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:12.436269 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.436551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.436828 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.437557 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:05:12.437863 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:12.439270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:12.447606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 596/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:12.453223 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:12.553077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd92c3c-386a-441d-bf58-7fa77f7ec3e3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:12.586431 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:12.587281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.587564 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.587838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] PATH_INFO: `/v3/users/189f07cee42442b884fb7dd9fa688697` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.589032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] RBAC: Authorizing `identity:get_user(user_id=189f07cee42442b884fb7dd9fa688697)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:12.590510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:12.592112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 594/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:05:12 2022] GET /identity/v3/users/189f07cee42442b884fb7dd9fa688697 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:12.597703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:12.654122 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:12.699666 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcb52a-001c-4d7d-b927-8027362cde8a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:12.736556 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54760f-6b05-4427-845c-cbd93884ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:12.737405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54760f-6b05-4427-845c-cbd93884ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.737683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54760f-6b05-4427-845c-cbd93884ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.737978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54760f-6b05-4427-845c-cbd93884ac88 None admin] PATH_INFO: `/v3/projects/70647ef430834f12b5f9141701620791` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.739137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54760f-6b05-4427-845c-cbd93884ac88 None admin] RBAC: Authorizing `identity:get_project(project_id=70647ef430834f12b5f9141701620791)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:12.740613 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54760f-6b05-4427-845c-cbd93884ac88 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:12.742332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 597/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:05:12 2022] GET /identity/v3/projects/70647ef430834f12b5f9141701620791 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:12.748271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:12.788350 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:12.853302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc026008-e0ba-4625-bb9b-f3eb175c33f1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:12.890909 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9a598-ab33-4156-bfd6-0507b9a0dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:12.891795 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a598-ab33-4156-bfd6-0507b9a0dbb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:12.892077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a598-ab33-4156-bfd6-0507b9a0dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:12.892352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9a598-ab33-4156-bfd6-0507b9a0dbb6 None admin] PATH_INFO: `/v3/projects/70647ef430834f12b5f9141701620791/users/189f07cee42442b884fb7dd9fa688697/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:12.894349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a598-ab33-4156-bfd6-0507b9a0dbb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=70647ef430834f12b5f9141701620791, user_id=189f07cee42442b884fb7dd9fa688697, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:12.896401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9a598-ab33-4156-bfd6-0507b9a0dbb6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:12.909304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 595/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:05:12 2022] PUT /identity/v3/projects/70647ef430834f12b5f9141701620791/users/189f07cee42442b884fb7dd9fa688697/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:05:15.134141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5112f-f955-4b1e-ac7b-c2ae6916c604 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:15.134670 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5112f-f955-4b1e-ac7b-c2ae6916c604 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:15.134670 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5112f-f955-4b1e-ac7b-c2ae6916c604 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:15.135973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 598/1193] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:05:15.141224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:15.141628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:15.141785 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:15.158923 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:05:15.160103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:05:15.224943 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 596/1194] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:05:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:05:15.247702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5112f-f955-4b1e-ac7b-c2ae6916c604 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:15.348703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5112f-f955-4b1e-ac7b-c2ae6916c604 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:15.371053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:15.383391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:15.384225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:15.384462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:15.384741 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:15.395089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:05:15.402852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:05:15.403921 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:05:15.404935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 599/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:05:15.409981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:15.437638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:15.508192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93dd7-8164-448d-bd34-b1a92798f996 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:15.542726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:15.543391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:15.543676 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:15.543951 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:15.544941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:05:15.545244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:15.546650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:15.554618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 597/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:05:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:15.560367 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:15.660948 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74373e85-7144-48ad-b657-31dcaa147568 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:15.696523 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:15.697373 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:15.697653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:15.697946 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] PATH_INFO: `/v3/users/189f07cee42442b884fb7dd9fa688697` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:15.699117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] RBAC: Authorizing `identity:get_user(user_id=189f07cee42442b884fb7dd9fa688697)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:15.700540 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:15.702159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 600/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue May 24 09:05:15 2022] GET /identity/v3/users/189f07cee42442b884fb7dd9fa688697 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:15.707856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:15.798686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:15.808964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a435f8-4f36-4534-a215-2647ba301a6b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:15.842673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:15.843315 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:15.843604 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:15.843883 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:15.908700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:15.910188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:15.995250 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:16.006122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 598/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:05:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:05:16.011939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:16.060955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:16.110101 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df4f9-7f86-40c9-9996-72bf50187e7a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:16.143559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5745912-132e-40a1-a5b7-4f3c6f264830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:16.144407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5745912-132e-40a1-a5b7-4f3c6f264830 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:16.144687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5745912-132e-40a1-a5b7-4f3c6f264830 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:16.144961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5745912-132e-40a1-a5b7-4f3c6f264830 None admin] PATH_INFO: `/v3/projects/70647ef430834f12b5f9141701620791` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:16.146317 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5745912-132e-40a1-a5b7-4f3c6f264830 None admin] RBAC: Authorizing `identity:get_project(project_id=70647ef430834f12b5f9141701620791)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:16.147748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5745912-132e-40a1-a5b7-4f3c6f264830 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:16.149410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 601/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue May 24 09:05:16 2022] GET /identity/v3/projects/70647ef430834f12b5f9141701620791 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:16.155391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:05:16.254812 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a79e4-8563-4306-92f3-390b374ae3d9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:05:16.288193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:05:16.288842 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:05:16.289129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:05:16.289406 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:05:16.290259 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=70647ef430834f12b5f9141701620791, user.id=189f07cee42442b884fb7dd9fa688697) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:05:16.290575 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:05:16.292006 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e368-5797-4a0b-bf6e-70cc4fc79daa None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:05:16.297986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 599/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:05:16 2022] GET /identity/v3/role_assignments?user.id=189f07cee42442b884fb7dd9fa688697&scope.project.id=70647ef430834f12b5f9141701620791&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:05:26.140033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=41 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:05:26.295416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=73 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:16.776535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a8a5-8e72-423f-9d11-f6e8ca30a591 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:16.777166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a8a5-8e72-423f-9d11-f6e8ca30a591 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:16.777166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a8a5-8e72-423f-9d11-f6e8ca30a591 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:16.778516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 602/1201] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:16.785198 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:16.785765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:16.785765 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:16.810631 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:16.811967 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:16.901358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 600/1202] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:16.934834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a8a5-8e72-423f-9d11-f6e8ca30a591 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:17.086354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a8a5-8e72-423f-9d11-f6e8ca30a591 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:17.129661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:17.130702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:17.131110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:17.131489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:17.150277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:17.151834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:17.176025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:17.177285 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:17.178361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:17.178361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:17.178361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:17.178361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:17.178361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 603/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:17.183650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:17.308819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382f097-b9b6-497b-a647-ccb39ba5afce None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:17.345932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:17.355997 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:17.357001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:17.357381 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:17.357661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:17.358513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:17.358816 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:17.360293 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3296d-b4ea-4479-8af3-43aa4c8d5d5f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:17.382435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 601/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:17.386636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:17.450255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:17.510834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6c89-5b16-4a7d-ba9e-8446a9d993bc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:17.574537 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c61946-cab9-45c6-9706-382de2fb38af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:17.575507 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c61946-cab9-45c6-9706-382de2fb38af None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:17.575941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c61946-cab9-45c6-9706-382de2fb38af None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:17.576377 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c61946-cab9-45c6-9706-382de2fb38af None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:17.577243 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c61946-cab9-45c6-9706-382de2fb38af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:17.578942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c61946-cab9-45c6-9706-382de2fb38af None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:17.609126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 604/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue May 24 09:06:17 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:06:19.985897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a70223-198e-4cdf-93ee-c82bde685d04 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:19.986456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a70223-198e-4cdf-93ee-c82bde685d04 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:19.986456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a70223-198e-4cdf-93ee-c82bde685d04 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:19.989055 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 602/1206] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:19.994785 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:19.995273 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:19.995363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:20.012493 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:20.013693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:20.095105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 605/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:20.120046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a70223-198e-4cdf-93ee-c82bde685d04 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:20.239916 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a70223-198e-4cdf-93ee-c82bde685d04 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:20.279916 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:20.280803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:20.281000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:20.281279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:20.292011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:06:20.300583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:20.302740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:20.304451 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 603/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:20.310178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:20.371066 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:20.459520 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650034cb-5f36-40b2-b236-96f1da97dbf8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:20.498699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:20.499401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:20.499716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:20.499968 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:20.500719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:20.501029 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:20.502485 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:20.511182 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 606/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:20.517756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:20.581129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:20.651810 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecae04-1d4a-4c23-a699-6f882c2bf21c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:20.690957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:20.691751 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:20.692034 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:20.692365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:20.703654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:20.705191 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:20.725301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:20.726541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:20.727616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:20.727616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:20.727616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:20.727616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:20.731454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 604/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:20.732880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:20.872762 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:20.876106 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443683-fd05-4f7a-a02b-5ee016bbcf29 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:20.923909 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:20.925024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:20.925411 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:20.925849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:20.927497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:20.928154 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:20.929821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:20.947449 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 607/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:20.953382 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:21.086066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc371a-35dc-4077-aaea-36e9d819e7e1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:21.087984 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:21.128782 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:21.129601 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:21.129882 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:21.130188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:21.139025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:21.141565 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:06:21.163018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:21.164140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:21.165291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:21.170955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 605/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:21.172605 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:21.319431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100aa9e-ceef-4226-bc51-8b4c92a2310d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:21.358543 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:21.359530 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:21.360028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:21.360455 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:21.361379 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:21.362341 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:21.364439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:21.386021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 608/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue May 24 09:06:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:21.392135 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:21.505221 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52210c87-45b2-4857-b779-362b05a2b522 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:21.541349 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:21.542198 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:21.542837 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:21.543215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:21.577036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:21.617465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:21.619105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:21.730367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 606/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:06:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:06:21.736403 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:21.760518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:21.872730 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ca2b6-bc83-4d4b-b53c-729cf7d3ae60 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:21.910412 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:21.911362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:21.911737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:21.912107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:21.922687 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:21.924561 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:21.943895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:21.945042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:21.950668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:21.950668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:21.950668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:21.950668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:21.950668 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 609/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:06:21.951018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:22.021600 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:22.069202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf214fb-fc22-4cc7-8437-ee889fda59d4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:22.110691 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:22.111343 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:22.112129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:22.112422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:22.113213 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:22.113594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:22.115165 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:22.132731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 607/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:22.134303 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:22.218944 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:22.261385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05524bd9-93a8-4904-9f87-caab94f1454b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:22.300407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:22.301361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:22.301744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:22.302149 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:22.309347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:22.310936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:06:22.326427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:22.327591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:22.328699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:22.333952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 610/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:22.334113 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:22.448302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189b49f-52e5-43a2-a53d-8640757d8a4d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:22.476129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:22.490824 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:22.491667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:22.492024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:22.492487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:22.493445 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:22.493857 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:22.495459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52065e3-7e18-47ab-8bb7-6fff4ce3e90a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:22.508700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 608/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:22.514575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:22.633509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617f4d2-1c19-4656-8810-dbe2b2702487 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:22.668220 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:22.677374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:22.677374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:22.677374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:22.677374 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:22.677814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=c279c9b085cf4ed29beb47b720834165) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:22.678071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:22.679659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d9f69-df41-43d1-8fd4-3e425718ab15 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:22.685866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 611/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:06:22 2022] GET /identity/v3/role_assignments?user.id=c279c9b085cf4ed29beb47b720834165&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:25.341044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e957a9-c7e5-44e4-817f-ba161a3f536e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:25.341619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e957a9-c7e5-44e4-817f-ba161a3f536e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:25.341619 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e957a9-c7e5-44e4-817f-ba161a3f536e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:25.343269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 609/1220] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:25.349369 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:25.349830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:25.349936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:25.368680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:25.369869 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:25.463625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 612/1221] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:25.491217 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e957a9-c7e5-44e4-817f-ba161a3f536e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:25.625840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e957a9-c7e5-44e4-817f-ba161a3f536e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:25.668454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:25.669308 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:25.669628 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:25.669916 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:25.681895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:06:25.690626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:25.691589 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:25.692527 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 610/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:25.699326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:25.826017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2fc7d-e33f-4fa8-b647-5a4bd5dfcdbf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:25.854052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:25.866688 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:25.867401 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:25.867884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:25.868315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:25.869361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:25.869669 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:25.871663 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:25.882927 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 613/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:25.889025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:25.936555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:26.002269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd9623-730a-4f64-a266-b6f33b1c2640 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:26.044972 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:26.045764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:26.046074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:26.046346 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:26.058086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:26.059566 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:26.077892 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:26.078890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:26.079891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:26.079891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:26.079891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:26.079891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:26.079891 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 611/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:26.085660 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:26.208846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c44a3-9e0b-45de-b6c6-38d95d80f4e5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:26.248289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:26.248955 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:26.249237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:26.249516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:26.250289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:26.250598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:26.251975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:26.263894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 614/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:26.271020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:26.379771 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:26.387352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316490-893a-453e-a1af-95bb191fd28b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:26.421384 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:26.422217 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:26.422499 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:26.422768 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:26.430970 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:26.432449 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:06:26.446835 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:26.447918 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:26.449020 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 612/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:26.454438 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:26.510646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:26.581284 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d4164-24b7-4e01-8391-aea11adeb4d7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:26.622566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:26.623236 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:26.623516 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:26.623792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:26.624614 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:26.624917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:26.626388 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:26.649577 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 615/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue May 24 09:06:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:06:26.655436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:26.775018 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb898d27-1bec-4c4f-9da2-3a96f3f89903 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:26.815912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:26.816742 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:26.817010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:26.817281 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:26.828432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:26.830870 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:26.847900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:26.848953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:26.849938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:26.849938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:26.849938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:26.849938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:26.849938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 613/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:26.855184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:26.965298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e39447-a4c4-4828-8524-dfa51d94f997 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:26.967846 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:27.004851 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:27.005678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:27.006069 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:27.006349 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:27.007252 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:27.007611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:27.009527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:27.021971 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 616/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:27.028090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:27.039586 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:27.148885 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafdc8c-3159-4eb5-9be8-3b507e864a4a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:27.185982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:27.186809 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:27.187152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:27.187461 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:27.195421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:27.196993 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:06:27.212182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:27.213160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:27.214194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 614/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:27.219522 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:27.333040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b481-84f6-4595-af4b-f35d3a3061ee None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:27.369475 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:27.370365 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:27.370706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:27.370966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:27.371961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:27.372279 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:27.374123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44854690-426a-416a-8ac7-4d7c861eafbb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:27.390524 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 617/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:06:27.397078 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:27.470273 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:27.508444 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1067-573e-49f6-8a51-8f2bbba522f0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:27.551312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96182fc-3756-407e-a1f6-f027a636cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:27.552266 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96182fc-3756-407e-a1f6-f027a636cef7 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:27.552550 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96182fc-3756-407e-a1f6-f027a636cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:27.552873 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96182fc-3756-407e-a1f6-f027a636cef7 None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/c279c9b085cf4ed29beb47b720834165/roles/e95fab0e69a94845b3ab9f33b7f1395c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:27.574916 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96182fc-3756-407e-a1f6-f027a636cef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=c279c9b085cf4ed29beb47b720834165, role_id=e95fab0e69a94845b3ab9f33b7f1395c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:27.576638 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96182fc-3756-407e-a1f6-f027a636cef7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:27.595058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 615/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:06:27 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/c279c9b085cf4ed29beb47b720834165/roles/e95fab0e69a94845b3ab9f33b7f1395c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:06:29.846570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bd8e1-9d14-4412-8e77-8f701b8417b0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:29.847176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bd8e1-9d14-4412-8e77-8f701b8417b0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:29.847176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bd8e1-9d14-4412-8e77-8f701b8417b0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:29.848601 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 618/1233] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:29.854002 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:29.854461 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:29.854636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:29.873435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:29.874901 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:29.949512 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 616/1234] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:29.974639 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bd8e1-9d14-4412-8e77-8f701b8417b0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:30.002714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:30.096189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bd8e1-9d14-4412-8e77-8f701b8417b0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:30.131603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:30.132419 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:30.132737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:30.132949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:30.143845 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:06:30.151554 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:30.152686 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:30.154051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 619/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue May 24 09:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:06:30.159945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:30.219573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:30.280654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ab94a-522d-4c81-adaf-05f4c6dd7056 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:30.323895 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:30.324946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:30.325341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:30.325762 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:30.327036 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:30.327490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:30.329700 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:30.343685 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 617/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue May 24 09:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:30.350407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:30.443732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:30.462542 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90faebd2-3c70-4a82-9bf3-bf47a8d063d4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:30.501307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:30.502728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:30.503013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:30.503300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:30.514751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:30.516234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:30.536659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:30.538147 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:30.539634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:30.539634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:30.539634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:30.539634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:30.539634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 620/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:06:30.545828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:30.678948 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723482-b9c5-4bde-8000-14b17d0e1d10 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:30.688820 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:30.719626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:30.720286 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:30.720571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:30.720878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:30.721594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:30.721897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:30.723292 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:30.736001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 618/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:30.741830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:30.848519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18481462-8d90-46bd-8e81-1c7b7e38d04f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:30.886315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:30.887146 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:30.887431 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:30.887708 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:30.890884 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:30.898765 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:30.900221 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:06:30.919288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:30.920307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:30.921257 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 621/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:06:30.927706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:31.039302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177fb3f-dd0e-4cf6-ab2c-bb69dc984cf6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:31.077026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:31.077730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:31.078079 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:31.078309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:31.079149 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:31.079466 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:31.081471 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:31.104172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 619/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue May 24 09:06:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:31.105678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:31.218932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a31b05-de8a-464b-9052-3d029a8d3c87 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:31.259141 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:31.259738 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:31.260063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:31.260380 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:31.328212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:31.335565 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:31.337004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:31.443593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 622/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:06:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:06:31.449479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:31.478406 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:31.560488 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646cf0c-899e-4c35-9ed7-576b35c07e11 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:31.612272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:31.613658 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:31.614270 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:31.614836 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:31.629899 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:31.631521 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:31.651025 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:31.652053 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:31.653138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:31.653138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:31.653138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:31.653138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:31.653138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 620/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:31.658028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:31.754089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:31.760403 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13884-f0f6-4cb8-afe4-0d9f51e99390 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:31.798275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:31.798999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:31.799296 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:31.799582 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:31.800306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:31.800615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:31.802018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:31.813826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 623/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:31.820271 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:31.908774 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:31.936122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2ca47-9434-42a3-b3a3-652085990f37 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:31.974054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:31.974848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:31.975128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:31.975401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:31.982469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:31.983985 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:06:31.998941 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:31.999958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:32.001347 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 621/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:32.006756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:32.117772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c971-22e0-41f6-9b9e-ac5eb8adbe0d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:32.157631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:32.159512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:32.159775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:32.160068 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:32.160937 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:32.161274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:32.162880 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81e4dd-6ec6-4c22-8214-d17fe1e6666b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:32.178276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 624/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:32.184832 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:32.305861 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a937ab6-7497-49ee-bf7b-5762e598cf60 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:32.349180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:32.350094 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:32.350400 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:32.350910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:32.351804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] RBAC: Adding query filter params (role.id=e95fab0e69a94845b3ab9f33b7f1395c, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=c279c9b085cf4ed29beb47b720834165) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:32.352068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:32.354015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9348-b005-4599-8d06-274f5311cddb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:32.361738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 622/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:06:32 2022] GET /identity/v3/role_assignments?user.id=c279c9b085cf4ed29beb47b720834165&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=e95fab0e69a94845b3ab9f33b7f1395c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:34.651951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141231a-a985-44d7-9422-eef8deda58ff None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:34.652525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141231a-a985-44d7-9422-eef8deda58ff None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:34.652525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141231a-a985-44d7-9422-eef8deda58ff None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:34.654015 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 625/1247] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:34.659720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:34.660228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:34.660336 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:34.666169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:34.679151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:34.680457 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:34.752746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 623/1248] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:34.779391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141231a-a985-44d7-9422-eef8deda58ff None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:34.801720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:34.897275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141231a-a985-44d7-9422-eef8deda58ff None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:34.942174 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:34.943038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:34.943387 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:34.943678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:34.954632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:06:34.962817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:34.963962 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:34.964825 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 626/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:34.970081 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:35.082515 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2b30f-5aaf-47af-98f9-0152bf84e9cb None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:35.115007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:35.122090 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:35.122978 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:35.123211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:35.123522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:35.124408 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:35.124792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:35.127321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:35.136652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 624/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:35.143142 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:35.231266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:35.261965 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67daf9-9183-4559-adb6-24686dd40825 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:35.301898 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:35.302951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:35.303347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:35.303742 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:35.316249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:35.317720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:35.334621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:35.340515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:35.341453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:35.341453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:35.341453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:35.341453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:35.341453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 627/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:35.341734 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:35.447424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b19a1c-f156-4a10-a077-76540d47d9b8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:35.491858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:35.492490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:35.492772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:35.493058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:35.493880 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:35.494245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:35.495799 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:35.511611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 625/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:35.518324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:35.638319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635e6a-e9f7-43b6-92a5-2ee302f15911 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:35.672773 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:35.682198 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:35.683013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:35.683297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:35.683569 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:35.692001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:35.693591 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:06:35.709436 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:35.710587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:35.711623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 628/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:35.716905 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:35.782730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:35.833097 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce912-413e-449d-ae51-660679ea9c68 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:35.870190 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:35.870886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:35.871173 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:35.871452 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:35.872320 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:35.872632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:35.874130 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:35.893780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 626/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue May 24 09:06:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:35.899625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:36.005512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22b8f-ac0c-4bb9-a5b3-326f28db3eda None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:36.041361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:36.042049 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:36.042593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:36.042866 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:36.102988 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:36.116811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:36.118332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:36.222189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 629/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:06:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:06:36.228203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:36.333151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb10b-c3b2-4fe8-8d97-67e08d6c74a0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:36.348480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:36.370672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:36.371554 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:36.371834 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:36.372106 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:36.382959 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:36.384411 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:36.401813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:36.402958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:36.404061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:36.404061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:36.404061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:36.404061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:36.407572 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 627/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:36.408855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:36.493833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:36.506731 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5ff6f-4ae4-44a3-adcb-4f63696c1885 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:36.540210 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:36.541056 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:36.541421 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:36.541716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:36.542891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:36.543300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:36.545206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:36.560976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 630/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:36.567240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:36.668659 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043510b5-5c50-45ec-b827-a3a1d9e133e0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:36.702878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:36.703652 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:36.703939 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:36.704221 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:36.710925 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:36.712373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:06:36.726304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:36.727719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:36.728846 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 628/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:36.733272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:36.832527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f910-5f4f-46a4-a239-8c33f2455dbc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:36.865348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:36.866023 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:36.866333 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:36.866608 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:36.867379 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:36.867685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:36.869129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6512c-3ad1-4c1b-a16b-9974afc70c50 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:36.881620 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 631/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:36.888034 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:36.913374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:36.987493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e57a1-055e-4599-9d84-248a26b0f47f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:37.019344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:37.019984 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:37.020269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:37.020544 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:37.021366 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=c279c9b085cf4ed29beb47b720834165) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:37.021676 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:37.023141 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65d050-819f-4b13-9490-53388afe50c1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:37.028396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 629/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:06:36 2022] GET /identity/v3/role_assignments?user.id=c279c9b085cf4ed29beb47b720834165&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=08b7b51186384e71b433ea9c52d3430e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:39.193890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79367b85-b8e8-4a7d-83ec-3af7d66ea345 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:39.194444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79367b85-b8e8-4a7d-83ec-3af7d66ea345 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:39.194444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79367b85-b8e8-4a7d-83ec-3af7d66ea345 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:39.195824 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 632/1261] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:39.200910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:39.201314 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:39.201472 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:39.218986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:39.220157 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:39.286910 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 630/1262] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:39.311016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79367b85-b8e8-4a7d-83ec-3af7d66ea345 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:39.322033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:39.412039 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79367b85-b8e8-4a7d-83ec-3af7d66ea345 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:39.445025 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:39.445745 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:39.446061 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:39.446337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:39.456952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:06:39.464559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:39.465634 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:39.466683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 633/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:39.472413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:39.490160 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:39.581537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07505ea-02e2-4f32-bfb7-6fcd52698abf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:39.626709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:39.627389 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:39.627671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:39.627942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:39.628684 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:39.628987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:39.630399 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:39.638334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 631/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:39.645138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:39.711093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:39.743627 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395062-0a01-458a-8dc1-179cdb6bbe27 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:39.776997 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:39.777768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:39.778077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:39.778351 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:39.789088 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:39.792852 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:39.808091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:39.809137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:39.810237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:39.810237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:39.810237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:39.810237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:39.810237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 634/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:39.815389 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:39.894871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:39.914415 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337de39-7af4-477d-9767-ad7e593d0662 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:39.947560 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:39.948211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:39.948495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:39.948770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:39.949482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:39.949786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:39.951185 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:39.962733 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 632/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:39.968192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:40.067949 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818edb2-ab18-40fa-a455-1c5b803c556d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:40.087584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:40.101677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:40.102479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:40.102761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:40.103033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:40.110187 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:40.112572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:06:40.126383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:40.127478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:40.128647 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 635/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:40.133667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:40.230968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d041-773e-469f-9953-80f4b1227b46 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:40.263052 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:40.263705 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:40.263989 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:40.264265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:40.265084 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:40.265391 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:40.266838 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:40.275777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:40.284757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 633/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue May 24 09:06:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:40.290207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:40.387752 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fab5e8-b219-4b4c-b27e-e0f623363233 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:40.420506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:40.421282 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:40.421568 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:40.421842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:40.432756 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:40.434231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:40.451399 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:40.452518 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:40.453772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:40.453772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:40.453772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:40.453772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:40.453772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 636/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:40.458202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:40.556879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06ded3-809d-446d-a6fa-47d89b7b96ec None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:40.594335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:40.594998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:40.595306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:40.595672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:40.596531 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:40.596839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:40.598236 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:40.609088 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 634/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:40.614710 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:40.647479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:40.715455 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594801ea-a4a2-4001-a20f-e7ef3a35aa1e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:40.747564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:40.748348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:40.748631 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:40.748908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:40.755979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:40.757419 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:06:40.772283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:40.773324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:40.774335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 637/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:40.779215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:40.838243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:40.879859 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008db6bb-d3a5-4d5e-b840-c21cebbeee3a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:40.912865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:40.913518 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:40.913801 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:40.914108 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:40.914889 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:40.915203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:40.916633 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca7c03-294e-4f32-a497-383994e60389 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:40.929370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 635/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:40.935486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:41.024607 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:41.034010 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a0bf-5a87-4363-a5c0-f11aa819969e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:41.066908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bbce7-ce27-4375-8d91-a2c94bf6350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:41.067770 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bbce7-ce27-4375-8d91-a2c94bf6350e None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:41.068051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bbce7-ce27-4375-8d91-a2c94bf6350e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:41.068326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bbce7-ce27-4375-8d91-a2c94bf6350e None admin] PATH_INFO: `/v3/projects/e224b74e66e14412b90d6324fe534a94/users/c279c9b085cf4ed29beb47b720834165/roles/08b7b51186384e71b433ea9c52d3430e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:41.070270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bbce7-ce27-4375-8d91-a2c94bf6350e None admin] RBAC: Authorizing `identity:create_grant(project_id=e224b74e66e14412b90d6324fe534a94, user_id=c279c9b085cf4ed29beb47b720834165, role_id=08b7b51186384e71b433ea9c52d3430e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:41.071713 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997bbce7-ce27-4375-8d91-a2c94bf6350e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:41.084276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 638/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue May 24 09:06:40 2022] PUT /identity/v3/projects/e224b74e66e14412b90d6324fe534a94/users/c279c9b085cf4ed29beb47b720834165/roles/08b7b51186384e71b433ea9c52d3430e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:06:43.221802 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40391f8a-9699-41df-946f-a74d7a7296e2 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:43.222390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40391f8a-9699-41df-946f-a74d7a7296e2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:43.222390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40391f8a-9699-41df-946f-a74d7a7296e2 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:43.223756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 636/1274] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:43.228985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:43.229405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:43.229538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:43.246329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:43.247509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:43.313001 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 639/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:43.336265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40391f8a-9699-41df-946f-a74d7a7296e2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:43.437365 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40391f8a-9699-41df-946f-a74d7a7296e2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:43.454693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:43.471720 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:43.472548 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:43.472786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:43.473063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:43.482933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:06:43.490804 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:43.491913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:43.492942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 637/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue May 24 09:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:43.499680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:43.592272 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:43.615937 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3e352-69a6-4224-b091-82be4a05c70a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:43.650448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:43.651105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:43.651388 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:43.651661 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:43.652392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:43.652699 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:43.654094 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:43.661980 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 640/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue May 24 09:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:43.667886 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:43.764428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68445b-af63-4bc3-8921-02ff367d64ef None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:43.799841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:43.800630 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:43.800913 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:43.801186 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:43.811655 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:43.813096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:43.830686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:43.831744 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:43.832651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:43.832651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:43.832651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:43.832651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:43.832651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 638/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:43.837494 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:43.934813 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92266-efaa-4af7-ad39-86ed4a136835 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:43.967021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:43.967662 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:43.967940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:43.968215 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:43.968917 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:43.969218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:43.970849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:43.982283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 641/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:43.988225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:44.018465 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:44.086144 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918c670-bb3a-47d1-a5ed-51718e12172c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:44.118968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:44.119756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:44.120038 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:44.120316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:44.128374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:44.129808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:06:44.144028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:44.145120 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:44.146348 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 639/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:44.152805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:44.156534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:44.253821 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba82d-9e45-4bfa-8af0-f75ec6fdc78e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:44.287506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:44.288100 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:44.288386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:44.288663 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:44.289487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:44.289798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:44.291261 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:44.308940 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 642/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue May 24 09:06:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:44.315041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:44.403686 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:44.413954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bae17-a643-4470-9e25-549b9a58306b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:44.447132 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:44.447757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:44.448037 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:44.448309 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:44.513184 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:44.514636 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:44.605215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:44.615954 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 640/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue May 24 09:06:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:06:44.621700 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:44.681789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:44.722050 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc511-0ec6-4f51-aa79-7f85c53c2124 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:44.754110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:44.754945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:44.755171 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:44.755444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:44.765060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:44.766526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:06:44.784891 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:44.785964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:44.786989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:06:44.786989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:06:44.786989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:06:44.786989 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:44.790074 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 643/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:44.791649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:44.890826 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e0fe-0cec-4e71-95f6-ab73772f301e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:44.924842 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:44.925495 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:44.925781 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:44.926092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:44.926811 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:44.927118 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:44.928485 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:44.940074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 641/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue May 24 09:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:06:44.945753 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:45.044396 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130488ff-ec9e-43b2-a828-d844a64d749e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:45.058393 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:45.078780 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:45.080664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:45.080950 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:45.081225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:45.087689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:45.089115 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:06:45.102942 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:45.103953 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 24 09:06:45.104901 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 644/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue May 24 09:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:45.109746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:45.159571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:45.209542 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae6e05-c004-4d7b-a122-24cf67c38d2a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:45.241224 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:45.241878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:45.242184 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:45.242459 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:45.243244 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:45.243551 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:45.244983 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd580-933a-4d9d-9c90-6159e3bbe9e8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:45.257386 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 642/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue May 24 09:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:45.263400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:45.363529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b436-eed5-48a8-8a6b-d017fae49b7a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:45.396249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:45.396888 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:45.397171 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:45.397443 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:45.398280 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] RBAC: Adding query filter params (role.id=08b7b51186384e71b433ea9c52d3430e, scope.project.id=e224b74e66e14412b90d6324fe534a94, user.id=c279c9b085cf4ed29beb47b720834165) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:45.398617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:45.400039 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead08dbd-c3f0-4039-81a1-da1b00fbe27f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:45.405705 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 645/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue May 24 09:06:45 2022] GET /identity/v3/role_assignments?user.id=c279c9b085cf4ed29beb47b720834165&scope.project.id=e224b74e66e14412b90d6324fe534a94&role.id=08b7b51186384e71b433ea9c52d3430e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:47.679805 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ed9ff-bb65-44be-8cae-cbe684f27314 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:47.680353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ed9ff-bb65-44be-8cae-cbe684f27314 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:47.680353 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ed9ff-bb65-44be-8cae-cbe684f27314 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:47.681736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 643/1288] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:47.686958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:47.687359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:47.687526 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:47.704677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:47.705849 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:47.734300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:47.772137 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 646/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:47.794241 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ed9ff-bb65-44be-8cae-cbe684f27314 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:47.894441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ed9ff-bb65-44be-8cae-cbe684f27314 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:47.904552 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:47.929152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:47.930005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:47.930239 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:47.930513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:47.931156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:47.932510 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:47.945312 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:47.946558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:47.947426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 644/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:06:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:47.952515 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:48.050234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6b34-e67c-4032-9742-6d102c6fbbd3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:48.084013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:48.084664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:48.084945 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:48.085218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:48.085935 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:48.086245 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:48.087606 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260265ca-8d25-47a5-a1a4-53b80bbf0491 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:48.092303 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 647/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue May 24 09:06:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:48.097858 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:48.195982 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c242e-7f8f-44f4-abf6-4c79fb776b3f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:48.228500 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:48.229148 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:48.229433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:48.229717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:48.230442 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:48.230749 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:48.232117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a73f-f167-4768-892c-03cc72b0e38f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:48.236563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 645/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue May 24 09:06:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:50.425754 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc700ef-ff08-403d-8610-3784261eee3a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:50.426312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc700ef-ff08-403d-8610-3784261eee3a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:50.426423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc700ef-ff08-403d-8610-3784261eee3a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:50.427834 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 648/1293] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:50.433051 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140ddc-dfb9-4507-a798-91d7c6359134 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:50.433444 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140ddc-dfb9-4507-a798-91d7c6359134 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:50.433611 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140ddc-dfb9-4507-a798-91d7c6359134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:50.450576 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-27140ddc-dfb9-4507-a798-91d7c6359134 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:50.451754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-27140ddc-dfb9-4507-a798-91d7c6359134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:50.481279 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:50.520026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 646/1294] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:50.544301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc700ef-ff08-403d-8610-3784261eee3a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:50.578628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:50.665892 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc700ef-ff08-403d-8610-3784261eee3a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:50.701510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145397cc-9a14-41f9-bc56-a4075eff1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:50.702121 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145397cc-9a14-41f9-bc56-a4075eff1f5c None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:50.702402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145397cc-9a14-41f9-bc56-a4075eff1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:50.702693 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145397cc-9a14-41f9-bc56-a4075eff1f5c None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:50.703407 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145397cc-9a14-41f9-bc56-a4075eff1f5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:50.704817 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145397cc-9a14-41f9-bc56-a4075eff1f5c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:50.717105 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 649/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue May 24 09:06:50 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:06:52.882642 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eab0-fb33-4774-b021-dbf758a9a6cf None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:52.883193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eab0-fb33-4774-b021-dbf758a9a6cf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:52.883193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959eab0-fb33-4774-b021-dbf758a9a6cf None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:52.884544 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 647/1296] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:52.889574 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:52.889976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:52.890157 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:52.906708 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:52.908060 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:52.978559 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 650/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:53.003272 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959eab0-fb33-4774-b021-dbf758a9a6cf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:53.108275 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959eab0-fb33-4774-b021-dbf758a9a6cf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:53.142829 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:53.143663 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:53.143967 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:53.144263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:53.144975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:53.146492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:53.159098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:53.160274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:53.161420 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 648/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:06:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:53.167093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:53.185426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:53.265445 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903026fa-e1f2-4650-a1c3-5dba6bb1f0e5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:53.299388 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:53.300037 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:53.300321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:53.300598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:53.301295 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:53.301604 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:53.303005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:53.308017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 651/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue May 24 09:06:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:06:53.314126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:53.345280 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:53.411578 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d1fd3-6530-4d21-b4a6-248a27f0da6b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:53.444390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:53.445037 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:53.445324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:53.445604 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:53.446416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] RBAC: Adding query filter params (interface=public, service_id=1c4ec402c2414ca2bd3699b6fef8e200, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:53.446732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:53.448096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ef308-34fb-4433-a916-3d333b79320b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:53.453016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 649/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue May 24 09:06:53 2022] GET /identity/v3/endpoints?service_id=1c4ec402c2414ca2bd3699b6fef8e200&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:53.459065 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:53.539593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:53.558632 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab042172-1ba7-4c11-a4bb-0f4fbbd89acc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:53.592283 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ffcc6-cbbe-4077-82a8-d131f19f100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:53.592931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ffcc6-cbbe-4077-82a8-d131f19f100a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:53.593211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ffcc6-cbbe-4077-82a8-d131f19f100a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:53.593482 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ffcc6-cbbe-4077-82a8-d131f19f100a None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:53.594181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ffcc6-cbbe-4077-82a8-d131f19f100a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:53.596081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ffcc6-cbbe-4077-82a8-d131f19f100a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:53.602737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 652/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue May 24 09:06:53 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:06:55.810935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a744455-8781-4e1f-8d7c-14c1cd6b694a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:55.811368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a744455-8781-4e1f-8d7c-14c1cd6b694a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:55.811503 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a744455-8781-4e1f-8d7c-14c1cd6b694a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:55.812865 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 650/1302] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:06:55.818857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:55.819301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:55.819423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:55.836533 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:06:55.837714 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:06:55.901716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 653/1303] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:06:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:06:55.924475 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a744455-8781-4e1f-8d7c-14c1cd6b694a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:56.018594 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:56.025662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a744455-8781-4e1f-8d7c-14c1cd6b694a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:56.059129 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:56.059859 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:56.060140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:56.060413 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:56.061058 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:56.062463 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:06:56.074748 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:06:56.075920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application May 24 09:06:56.076957 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 651/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue May 24 09:06:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:06:56.082288 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:56.157330 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:06:56.181145 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec46bb9-067d-4a32-89c4-36854bd38895 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:56.214476 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:56.215131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:56.215417 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:56.215722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:56.216419 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:06:56.216732 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:56.218127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938fbf-0de8-4bf6-a7ff-c49703966812 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:56.223697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 654/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue May 24 09:06:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:06:56.229412 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:06:56.325726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b645f-95c5-4e20-93c6-d7240168ba25 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:06:56.358067 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed6cac-5102-47d1-ad6d-6ea3b0b2b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:06:56.358706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6cac-5102-47d1-ad6d-6ea3b0b2b037 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:06:56.358986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6cac-5102-47d1-ad6d-6ea3b0b2b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:06:56.359258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed6cac-5102-47d1-ad6d-6ea3b0b2b037 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:06:56.359993 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6cac-5102-47d1-ad6d-6ea3b0b2b037 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:06:56.361563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed6cac-5102-47d1-ad6d-6ea3b0b2b037 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:06:56.379329 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 652/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue May 24 09:06:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:07:06.220843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=30 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:07:06.375296 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:00.428024 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6aa7f-cdf6-41ab-b8ad-563b25b77900 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:00.428621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6aa7f-cdf6-41ab-b8ad-563b25b77900 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:00.428621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6aa7f-cdf6-41ab-b8ad-563b25b77900 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:00.430148 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 655/1307] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:00.435358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58bba-861b-4819-b920-9c900c9f6de8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:00.436260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58bba-861b-4819-b920-9c900c9f6de8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:00.436831 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b58bba-861b-4819-b920-9c900c9f6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:00.516162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e8b58bba-861b-4819-b920-9c900c9f6de8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:00.517436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e8b58bba-861b-4819-b920-9c900c9f6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:00.638409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 653/1308] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:00.694270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f3dd0-6ec5-41be-b8ad-ec584d7b084b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:00.694270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f3dd0-6ec5-41be-b8ad-ec584d7b084b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:00.694270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f3dd0-6ec5-41be-b8ad-ec584d7b084b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:00.694270 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 656/1309] 10.222.0.30 () {54 vars in 964 bytes} [Tue May 24 09:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:00.702917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b66e4-b3eb-43a1-9ec5-f9e7426b60c2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:00.703677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b66e4-b3eb-43a1-9ec5-f9e7426b60c2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:00.704436 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b66e4-b3eb-43a1-9ec5-f9e7426b60c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:00.812037 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-881b66e4-b3eb-43a1-9ec5-f9e7426b60c2 None None] MFA Rules not processed for user `061ff7358d4e45cdaaa15196aef8c4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:00.813368 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-881b66e4-b3eb-43a1-9ec5-f9e7426b60c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:00.840859 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:00.902821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 654/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Tue May 24 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:08:00.912362 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f3dd0-6ec5-41be-b8ad-ec584d7b084b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:00.914389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f63f3dd0-6ec5-41be-b8ad-ec584d7b084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:01.036213 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f3dd0-6ec5-41be-b8ad-ec584d7b084b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:01.115460 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:01.116069 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:01.116348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:01.116625 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:01.118378 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:01.178950 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:01.238366 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:01.239816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f5fa-f64b-4411-8e4d-7d71bdaffb1f service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:01.259227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 657/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:03.851274 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e033d6-507a-4ec4-9c28-caf4292b02a5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:03.851792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e033d6-507a-4ec4-9c28-caf4292b02a5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:03.851887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e033d6-507a-4ec4-9c28-caf4292b02a5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:03.854116 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 655/1312] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:03.859533 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477706-2eb8-441c-a9ad-19b468c82592 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:03.860017 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477706-2eb8-441c-a9ad-19b468c82592 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:03.860098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2477706-2eb8-441c-a9ad-19b468c82592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:03.963385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f2477706-2eb8-441c-a9ad-19b468c82592 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:03.964877 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f2477706-2eb8-441c-a9ad-19b468c82592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:04.078513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 658/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:04.117077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e033d6-507a-4ec4-9c28-caf4292b02a5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:04.118772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-63e033d6-507a-4ec4-9c28-caf4292b02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:04.232364 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e033d6-507a-4ec4-9c28-caf4292b02a5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:04.307963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:04.311449 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:04.312482 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:04.313210 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:04.313702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:04.315760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:04.431757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:04.433321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b093497-d8ba-42fd-8f79-47ddda094d48 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:04.453595 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 656/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:07.043316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442669-e7b3-4e9b-b8fc-342404931748 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:07.043842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442669-e7b3-4e9b-b8fc-342404931748 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:07.043842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1442669-e7b3-4e9b-b8fc-342404931748 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:07.046337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 659/1315] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:07.051610 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df4d3-6886-482c-8f6d-850495f431fb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:07.052031 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df4d3-6886-482c-8f6d-850495f431fb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:07.052199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df4d3-6886-482c-8f6d-850495f431fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:07.115319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1e5df4d3-6886-482c-8f6d-850495f431fb None None] MFA Rules not processed for user `90ae04531d9d4084be238a8e8c7877d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:07.116504 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1e5df4d3-6886-482c-8f6d-850495f431fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:07.166755 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:07.210001 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 657/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:07.249409 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442669-e7b3-4e9b-b8fc-342404931748 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:07.250975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d1442669-e7b3-4e9b-b8fc-342404931748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:07.260812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:07.354998 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1442669-e7b3-4e9b-b8fc-342404931748 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:07.428961 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:07.429602 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:07.429883 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:07.430190 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:07.431833 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:07.494432 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:07.542234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:07.543708 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed94836-ebbd-4f39-9e0f-5c839ebe5b61 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:07.563497 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 660/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:10.299197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25547-9fea-4061-8796-9dcd33f40c2e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:10.299738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25547-9fea-4061-8796-9dcd33f40c2e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:10.299738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25547-9fea-4061-8796-9dcd33f40c2e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:10.301112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 658/1318] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:10.306548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb35d4-a137-4b4f-ac8f-274f04080244 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:10.306958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb35d4-a137-4b4f-ac8f-274f04080244 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:10.307144 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb35d4-a137-4b4f-ac8f-274f04080244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:10.371162 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6efb35d4-a137-4b4f-ac8f-274f04080244 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:10.372359 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6efb35d4-a137-4b4f-ac8f-274f04080244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:10.468300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 661/1319] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:10.506095 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25547-9fea-4061-8796-9dcd33f40c2e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:10.507623 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3fd25547-9fea-4061-8796-9dcd33f40c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:10.611508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25547-9fea-4061-8796-9dcd33f40c2e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:10.682555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:10.683197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:10.683479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:10.683752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:10.685410 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:10.692769 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:10.791876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:10.793179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168fe7b-fad6-44b7-b8dc-56efd4b33467 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:10.812297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 659/1320] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:13.674449 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa7900-3375-4824-b654-d9138522d40f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:13.674982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa7900-3375-4824-b654-d9138522d40f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:13.674982 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa7900-3375-4824-b654-d9138522d40f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:13.676346 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 662/1321] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:13.681649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1057a-55e8-4d86-876f-8477ac832874 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:13.682128 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1057a-55e8-4d86-876f-8477ac832874 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:13.682225 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1057a-55e8-4d86-876f-8477ac832874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:13.750470 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b2a1057a-55e8-4d86-876f-8477ac832874 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:13.751668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b2a1057a-55e8-4d86-876f-8477ac832874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:13.815159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:13.859786 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 660/1322] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:13.913160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b478-a424-455d-8dbc-f2dcc03ee588 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:13.913566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b478-a424-455d-8dbc-f2dcc03ee588 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:13.913937 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b478-a424-455d-8dbc-f2dcc03ee588 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:13.915575 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 663/1323] 10.222.0.30 () {54 vars in 964 bytes} [Tue May 24 09:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:13.923152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c860b8-76d7-450f-83f7-73a072f20834 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:13.923445 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c860b8-76d7-450f-83f7-73a072f20834 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:13.923724 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c860b8-76d7-450f-83f7-73a072f20834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:14.010715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-26c860b8-76d7-450f-83f7-73a072f20834 None None] MFA Rules not processed for user `061ff7358d4e45cdaaa15196aef8c4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:14.011965 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-26c860b8-76d7-450f-83f7-73a072f20834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:14.103757 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 661/1324] 10.222.0.30 () {58 vars in 1061 bytes} [Tue May 24 09:08:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:14.113297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b478-a424-455d-8dbc-f2dcc03ee588 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:14.114894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2b08b478-a424-455d-8dbc-f2dcc03ee588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:14.139354 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:14.238051 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b478-a424-455d-8dbc-f2dcc03ee588 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:14.317589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:14.318305 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:14.318589 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:14.318868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:14.320761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:14.394928 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:14.434774 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:14.436922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422d575-4d6d-4cfc-b840-8735905f27db service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:14.460838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 664/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:16.944511 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9a49-1032-4506-9cb7-b1b896700716 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:16.945044 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9a49-1032-4506-9cb7-b1b896700716 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:16.945172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f9a49-1032-4506-9cb7-b1b896700716 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:16.946478 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 662/1326] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:16.951932 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040fbeb-9605-4faf-8338-c11c2224b2fd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:16.952348 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040fbeb-9605-4faf-8338-c11c2224b2fd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:16.952503 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040fbeb-9605-4faf-8338-c11c2224b2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:17.019123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9040fbeb-9605-4faf-8338-c11c2224b2fd None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:17.020324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9040fbeb-9605-4faf-8338-c11c2224b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:17.120995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 665/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:17.156879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f9a49-1032-4506-9cb7-b1b896700716 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:17.158573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ff9f9a49-1032-4506-9cb7-b1b896700716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:17.222215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:17.267297 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f9a49-1032-4506-9cb7-b1b896700716 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:17.343618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:17.344269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:17.344558 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:17.344841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:17.346540 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:17.454643 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:17.457999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:17.460101 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347289ba-1360-4ef9-bbb6-823dd5e679b4 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:17.478799 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 663/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:19.766744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026ae1f-c594-4e20-9e2c-a596476229f7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:19.769484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026ae1f-c594-4e20-9e2c-a596476229f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:19.769484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026ae1f-c594-4e20-9e2c-a596476229f7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:19.769484 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 666/1329] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:19.774046 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7e99-cea7-4229-951d-7dac83ef858d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:19.774467 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7e99-cea7-4229-951d-7dac83ef858d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:19.774762 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7e99-cea7-4229-951d-7dac83ef858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:19.841210 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ca8e7e99-cea7-4229-951d-7dac83ef858d None None] MFA Rules not processed for user `90ae04531d9d4084be238a8e8c7877d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:19.842484 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ca8e7e99-cea7-4229-951d-7dac83ef858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:19.938003 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 664/1330] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:19.974274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026ae1f-c594-4e20-9e2c-a596476229f7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:19.975842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5026ae1f-c594-4e20-9e2c-a596476229f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:20.009255 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:20.083596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026ae1f-c594-4e20-9e2c-a596476229f7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:20.159183 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:20.159835 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:20.160123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:20.160394 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:20.162085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:20.241080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:20.273812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:20.275304 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc45ab-c46d-4e45-8e25-3a1d43208b29 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:20.294256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 667/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:22.750612 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157afd3-a0a5-4e8a-ae5e-92da89f88f94 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:22.751193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157afd3-a0a5-4e8a-ae5e-92da89f88f94 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:22.751193 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157afd3-a0a5-4e8a-ae5e-92da89f88f94 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:22.752546 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 665/1332] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:22.758160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9265b6-2a6f-439e-a085-b7d3bb9d29a4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:22.758646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9265b6-2a6f-439e-a085-b7d3bb9d29a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:22.758749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9265b6-2a6f-439e-a085-b7d3bb9d29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:22.843674 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0e9265b6-2a6f-439e-a085-b7d3bb9d29a4 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:22.844902 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0e9265b6-2a6f-439e-a085-b7d3bb9d29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:22.948995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 668/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:22.985028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157afd3-a0a5-4e8a-ae5e-92da89f88f94 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:22.986615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3157afd3-a0a5-4e8a-ae5e-92da89f88f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:23.063571 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:23.098253 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157afd3-a0a5-4e8a-ae5e-92da89f88f94 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:23.173519 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:23.174264 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:23.174591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:23.174887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:23.176704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:23.285591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:23.287004 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165ff42-67b3-4548-8348-7c181d1f8b23 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:23.296980 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:23.305626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 666/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:25.585486 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f3e8-f83d-45bc-bf3b-a3831594ff46 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:25.586079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f3e8-f83d-45bc-bf3b-a3831594ff46 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:25.586079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f3e8-f83d-45bc-bf3b-a3831594ff46 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:25.587442 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 669/1335] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:25.593828 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454ced9-2ffc-4c16-ad75-fdf53b17ac05 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:25.594284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454ced9-2ffc-4c16-ad75-fdf53b17ac05 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:25.594416 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454ced9-2ffc-4c16-ad75-fdf53b17ac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:25.659890 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a454ced9-2ffc-4c16-ad75-fdf53b17ac05 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:25.661078 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a454ced9-2ffc-4c16-ad75-fdf53b17ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:25.757007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 667/1336] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:25.796887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f3e8-f83d-45bc-bf3b-a3831594ff46 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:25.798463 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fc30f3e8-f83d-45bc-bf3b-a3831594ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:25.839642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:25.903107 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f3e8-f83d-45bc-bf3b-a3831594ff46 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:25.976618 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:25.977256 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:25.977534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:25.977805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:25.979470 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:26.061143 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:26.086761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:26.088192 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdfd6d-6e43-401e-ba80-4fc1f5b70506 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:26.106749 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 670/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:28.933932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476908-696b-4ff4-803e-1cece991e82a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:28.934489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476908-696b-4ff4-803e-1cece991e82a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:28.934489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476908-696b-4ff4-803e-1cece991e82a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:28.935987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 668/1338] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:28.941158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4504-4adf-4e2b-af42-b8462de51856 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:28.941593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4504-4adf-4e2b-af42-b8462de51856 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:28.941697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4504-4adf-4e2b-af42-b8462de51856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:29.006077 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-857d4504-4adf-4e2b-af42-b8462de51856 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:29.007286 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-857d4504-4adf-4e2b-af42-b8462de51856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:29.104787 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 671/1339] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:29.140678 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476908-696b-4ff4-803e-1cece991e82a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:29.142230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0d476908-696b-4ff4-803e-1cece991e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:29.217741 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:29.245189 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476908-696b-4ff4-803e-1cece991e82a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:29.317363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:29.318039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:29.318316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:29.318596 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:29.320222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:29.429005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:29.430474 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b867b-e230-4a8b-b1bb-14c7c0c5427d service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:29.449041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 669/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:33.771028 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f16f5-1ea8-4a97-9495-b4d20b4bdb7d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:33.771623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f16f5-1ea8-4a97-9495-b4d20b4bdb7d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:33.771623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f16f5-1ea8-4a97-9495-b4d20b4bdb7d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:33.772977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 672/1341] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:33.778230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5771-c118-4876-9cf1-5545dde38211 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:33.778649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5771-c118-4876-9cf1-5545dde38211 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:33.778737 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5771-c118-4876-9cf1-5545dde38211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:33.785372 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:33.862615 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-aeeb5771-c118-4876-9cf1-5545dde38211 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:33.863821 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-aeeb5771-c118-4876-9cf1-5545dde38211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:33.970334 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 670/1342] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:34.008645 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f16f5-1ea8-4a97-9495-b4d20b4bdb7d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:34.010826 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-465f16f5-1ea8-4a97-9495-b4d20b4bdb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:34.064153 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:34.111206 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f16f5-1ea8-4a97-9495-b4d20b4bdb7d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:34.115117 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672ae0-63f1-4d7c-972b-d37a3bb82ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:34.115772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672ae0-63f1-4d7c-972b-d37a3bb82ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:34.116057 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672ae0-63f1-4d7c-972b-d37a3bb82ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:34.116336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672ae0-63f1-4d7c-972b-d37a3bb82ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:34.125842 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672ae0-63f1-4d7c-972b-d37a3bb82ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:34.127308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672ae0-63f1-4d7c-972b-d37a3bb82ee3 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:34.136798 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 673/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:36.943441 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e5573-beae-4196-b418-7e2f5cbcd320 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:36.943988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e5573-beae-4196-b418-7e2f5cbcd320 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:36.943988 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e5573-beae-4196-b418-7e2f5cbcd320 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:36.945373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 671/1344] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:08:36.950725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301279-78e1-4f2f-8d70-798d0e8f5cd4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:36.951320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301279-78e1-4f2f-8d70-798d0e8f5cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:36.951410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301279-78e1-4f2f-8d70-798d0e8f5cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:36.979044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-32301279-78e1-4f2f-8d70-798d0e8f5cd4 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:36.980237 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-32301279-78e1-4f2f-8d70-798d0e8f5cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:37.058278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 674/1345] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:08:37.095907 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e5573-beae-4196-b418-7e2f5cbcd320 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:37.106577 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e5573-beae-4196-b418-7e2f5cbcd320 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:37.110211 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220683ed-1176-4a7b-9f4a-2655b01a37c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:37.110848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220683ed-1176-4a7b-9f4a-2655b01a37c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:37.111134 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220683ed-1176-4a7b-9f4a-2655b01a37c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:37.111414 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220683ed-1176-4a7b-9f4a-2655b01a37c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:37.120456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220683ed-1176-4a7b-9f4a-2655b01a37c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:37.121920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220683ed-1176-4a7b-9f4a-2655b01a37c4 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:37.131477 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 672/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:41.235081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128432c-e803-489e-8ebd-3bbb81dc59c6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:41.235565 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128432c-e803-489e-8ebd-3bbb81dc59c6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:41.235681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128432c-e803-489e-8ebd-3bbb81dc59c6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:41.237947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 675/1347] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:41.242839 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff39e9-e362-465d-86a1-e586a3e4f018 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:41.243255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff39e9-e362-465d-86a1-e586a3e4f018 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:41.243417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff39e9-e362-465d-86a1-e586a3e4f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:41.261760 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0aff39e9-e362-465d-86a1-e586a3e4f018 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:41.262998 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0aff39e9-e362-465d-86a1-e586a3e4f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:41.272237 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 673/1348] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:41.309158 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128432c-e803-489e-8ebd-3bbb81dc59c6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:41.320958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128432c-e803-489e-8ebd-3bbb81dc59c6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:41.324446 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148525a4-6ea3-4772-8dab-ccfe14a97824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:41.325085 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148525a4-6ea3-4772-8dab-ccfe14a97824 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:41.325370 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148525a4-6ea3-4772-8dab-ccfe14a97824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:41.325648 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148525a4-6ea3-4772-8dab-ccfe14a97824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:41.335092 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148525a4-6ea3-4772-8dab-ccfe14a97824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:41.336535 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148525a4-6ea3-4772-8dab-ccfe14a97824 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:41.345946 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 676/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:46.777382 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bae32-2556-48ac-8843-20dc6bc55b31 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:46.778360 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bae32-2556-48ac-8843-20dc6bc55b31 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:46.778907 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bae32-2556-48ac-8843-20dc6bc55b31 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:46.781158 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 674/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue May 24 09:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:46.786519 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2260c-c5e1-431c-8b94-5ec8b7fd60d3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:46.786969 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2260c-c5e1-431c-8b94-5ec8b7fd60d3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:46.787052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2260c-c5e1-431c-8b94-5ec8b7fd60d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:46.890504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a5c2260c-c5e1-431c-8b94-5ec8b7fd60d3 None None] MFA Rules not processed for user `c279c9b085cf4ed29beb47b720834165`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:46.891948 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a5c2260c-c5e1-431c-8b94-5ec8b7fd60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:46.941159 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:47.080336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 677/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue May 24 09:08:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:51.191192 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e6d0-d2de-4c46-a8fa-a9a7d6c744a8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:51.191779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e6d0-d2de-4c46-a8fa-a9a7d6c744a8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:51.192086 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e6d0-d2de-4c46-a8fa-a9a7d6c744a8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:51.193713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 675/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue May 24 09:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:51.198739 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fce50-6248-4187-9e93-b6eb2c48a8a8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:51.199217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fce50-6248-4187-9e93-b6eb2c48a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:51.199313 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fce50-6248-4187-9e93-b6eb2c48a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:51.219882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b52fce50-6248-4187-9e93-b6eb2c48a8a8 None None] MFA Rules not processed for user `c279c9b085cf4ed29beb47b720834165`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:51.221072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b52fce50-6248-4187-9e93-b6eb2c48a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:51.230678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 678/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue May 24 09:08:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:51.256772 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=72 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:08:52.764082 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305f15-91e1-455c-bc6f-a9bc6332cc8a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:52.764706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305f15-91e1-455c-bc6f-a9bc6332cc8a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:52.764706 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305f15-91e1-455c-bc6f-a9bc6332cc8a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:52.766043 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 676/1354] 10.222.0.30 () {54 vars in 921 bytes} [Tue May 24 09:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:52.771202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f123e3-7d0e-4abf-ae8f-30a97f2e4f0e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:52.771621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f123e3-7d0e-4abf-ae8f-30a97f2e4f0e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:52.772009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f123e3-7d0e-4abf-ae8f-30a97f2e4f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:52.792543 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-17f123e3-7d0e-4abf-ae8f-30a97f2e4f0e None None] MFA Rules not processed for user `c279c9b085cf4ed29beb47b720834165`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:52.793775 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-17f123e3-7d0e-4abf-ae8f-30a97f2e4f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:52.803271 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 679/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue May 24 09:08:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:56.878429 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a91d74-10be-413b-9b25-36636c545154 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:56.878975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a91d74-10be-413b-9b25-36636c545154 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:56.878975 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a91d74-10be-413b-9b25-36636c545154 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:56.880342 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 677/1356] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:56.886037 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29e0b0-73f9-4a85-99ac-d1f50524b47e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:56.886452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29e0b0-73f9-4a85-99ac-d1f50524b47e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:56.886793 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29e0b0-73f9-4a85-99ac-d1f50524b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:56.916922 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ac29e0b0-73f9-4a85-99ac-d1f50524b47e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:56.918150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ac29e0b0-73f9-4a85-99ac-d1f50524b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:56.928925 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 680/1357] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:56.979662 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73e9f-662c-4964-9ad8-22cd30594d83 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:56.980246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73e9f-662c-4964-9ad8-22cd30594d83 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:56.980778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73e9f-662c-4964-9ad8-22cd30594d83 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:56.983964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 678/1358] 10.222.0.30 () {54 vars in 961 bytes} [Tue May 24 09:08:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:56.991071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd0a5-3db4-4b52-9057-b81a21c70422 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:56.991621 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd0a5-3db4-4b52-9057-b81a21c70422 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:56.992123 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd0a5-3db4-4b52-9057-b81a21c70422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:57.048538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-899fd0a5-3db4-4b52-9057-b81a21c70422 None None] MFA Rules not processed for user `10ba53ef4d604f33aa31e50d053f3641`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:57.049786 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-899fd0a5-3db4-4b52-9057-b81a21c70422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:57.138091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 681/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Tue May 24 09:08:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:57.146385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73e9f-662c-4964-9ad8-22cd30594d83 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:57.161445 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73e9f-662c-4964-9ad8-22cd30594d83 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:57.167314 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed839580-26f6-4a53-a986-bc253b92ab1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:57.168159 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed839580-26f6-4a53-a986-bc253b92ab1f service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:57.168505 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed839580-26f6-4a53-a986-bc253b92ab1f service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:57.168843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed839580-26f6-4a53-a986-bc253b92ab1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:57.178220 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed839580-26f6-4a53-a986-bc253b92ab1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:57.179935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed839580-26f6-4a53-a986-bc253b92ab1f service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:57.191497 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 679/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:08:59.622508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66aa9-85f8-48d2-83aa-6ee65ecbc7b4 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:59.623091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66aa9-85f8-48d2-83aa-6ee65ecbc7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:59.623091 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66aa9-85f8-48d2-83aa-6ee65ecbc7b4 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:59.624643 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 682/1361] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:08:59.629823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f328a-ad15-4dc2-9f3f-960dd6969324 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:59.630301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f328a-ad15-4dc2-9f3f-960dd6969324 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:59.630427 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f328a-ad15-4dc2-9f3f-960dd6969324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:59.649085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c30f328a-ad15-4dc2-9f3f-960dd6969324 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:08:59.650255 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c30f328a-ad15-4dc2-9f3f-960dd6969324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:08:59.659021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 680/1362] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:08:59.703950 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66aa9-85f8-48d2-83aa-6ee65ecbc7b4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:08:59.719972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66aa9-85f8-48d2-83aa-6ee65ecbc7b4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:08:59.725406 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a318f-8ff9-4209-b65b-ee63cfc7b943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:08:59.726087 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a318f-8ff9-4209-b65b-ee63cfc7b943 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:08:59.726376 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a318f-8ff9-4209-b65b-ee63cfc7b943 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:08:59.726655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a318f-8ff9-4209-b65b-ee63cfc7b943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:08:59.736160 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a318f-8ff9-4209-b65b-ee63cfc7b943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:08:59.737772 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a318f-8ff9-4209-b65b-ee63cfc7b943 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:08:59.748347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 683/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:02.329711 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d3a6-d8f2-42c8-9542-5864e80b6512 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:02.330333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d3a6-d8f2-42c8-9542-5864e80b6512 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:02.330333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d3a6-d8f2-42c8-9542-5864e80b6512 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:02.331670 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 681/1364] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:02.336803 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c192e9d-c08a-4ffa-8253-f7206d6627ee None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:02.337214 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c192e9d-c08a-4ffa-8253-f7206d6627ee None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:02.337363 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c192e9d-c08a-4ffa-8253-f7206d6627ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:02.356124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3c192e9d-c08a-4ffa-8253-f7206d6627ee None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:02.357924 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3c192e9d-c08a-4ffa-8253-f7206d6627ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:02.366514 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 684/1365] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:02.413790 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df38d-8c12-4cd5-9228-74f25452dd3c None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:02.414215 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df38d-8c12-4cd5-9228-74f25452dd3c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:02.414480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df38d-8c12-4cd5-9228-74f25452dd3c None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:02.416860 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 682/1366] 10.222.0.30 () {54 vars in 961 bytes} [Tue May 24 09:09:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:02.426225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f347-7dd4-4148-9eec-93481b376e21 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:02.426731 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f347-7dd4-4148-9eec-93481b376e21 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:02.427163 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2f347-7dd4-4148-9eec-93481b376e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:02.479108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2eb2f347-7dd4-4148-9eec-93481b376e21 None None] MFA Rules not processed for user `10ba53ef4d604f33aa31e50d053f3641`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:02.480680 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2eb2f347-7dd4-4148-9eec-93481b376e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:02.498391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 685/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Tue May 24 09:09:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:02.508462 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df38d-8c12-4cd5-9228-74f25452dd3c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:02.524986 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df38d-8c12-4cd5-9228-74f25452dd3c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:02.531738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ea6c4-4192-4b2c-9008-b0443a66672e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:02.532798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ea6c4-4192-4b2c-9008-b0443a66672e service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:02.533299 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ea6c4-4192-4b2c-9008-b0443a66672e service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:02.533730 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ea6c4-4192-4b2c-9008-b0443a66672e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:02.543717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ea6c4-4192-4b2c-9008-b0443a66672e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:02.545963 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ea6c4-4192-4b2c-9008-b0443a66672e service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:02.559207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 683/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 09:09:04.889234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea33a-d726-4961-acfc-e6dbc31b3130 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:04.889810 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea33a-d726-4961-acfc-e6dbc31b3130 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:04.889810 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aea33a-d726-4961-acfc-e6dbc31b3130 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:04.891218 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 686/1369] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:04.896525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329cc8-f637-426c-8fd8-0921f1553bd8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:04.896961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329cc8-f637-426c-8fd8-0921f1553bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:04.897081 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31329cc8-f637-426c-8fd8-0921f1553bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:04.916549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-31329cc8-f637-426c-8fd8-0921f1553bd8 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:04.917898 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-31329cc8-f637-426c-8fd8-0921f1553bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:04.926927 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 684/1370] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:04.970864 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea33a-d726-4961-acfc-e6dbc31b3130 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:04.987138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aea33a-d726-4961-acfc-e6dbc31b3130 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:04.993400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae24d90-f511-4713-bb2a-cd2e43bf6455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:04.994227 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae24d90-f511-4713-bb2a-cd2e43bf6455 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:04.994624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae24d90-f511-4713-bb2a-cd2e43bf6455 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:04.995012 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae24d90-f511-4713-bb2a-cd2e43bf6455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:05.005306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae24d90-f511-4713-bb2a-cd2e43bf6455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:05.007093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae24d90-f511-4713-bb2a-cd2e43bf6455 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:05.019307 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 687/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:05.234633 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7102e78-825f-470b-997c-073617d1aee4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:05.234915 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7102e78-825f-470b-997c-073617d1aee4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:05.235393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7102e78-825f-470b-997c-073617d1aee4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:05.236813 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 685/1372] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:05.242822 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937d72-6596-412c-a0f5-0a7d9b196e31 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:05.243112 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937d72-6596-412c-a0f5-0a7d9b196e31 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:05.243389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937d72-6596-412c-a0f5-0a7d9b196e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:05.263975 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-06937d72-6596-412c-a0f5-0a7d9b196e31 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:05.265226 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-06937d72-6596-412c-a0f5-0a7d9b196e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:05.273494 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 688/1373] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:05.588673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0b16-115d-4174-82ed-3cfb476b952e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:05.589256 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0b16-115d-4174-82ed-3cfb476b952e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:05.589651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f0b16-115d-4174-82ed-3cfb476b952e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:05.591537 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 686/1374] 10.222.0.30 () {54 vars in 963 bytes} [Tue May 24 09:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:05.597983 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464cd7-ce5c-4581-94f3-2876b133ac83 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:05.598319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464cd7-ce5c-4581-94f3-2876b133ac83 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:05.598607 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464cd7-ce5c-4581-94f3-2876b133ac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:05.607471 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:09:05.653239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-77464cd7-ce5c-4581-94f3-2876b133ac83 None None] MFA Rules not processed for user `cccb32a47f7d4144b224d9fcc99091e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:05.655021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-77464cd7-ce5c-4581-94f3-2876b133ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:05.717832 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 689/1375] 10.222.0.30 () {58 vars in 1060 bytes} [Tue May 24 09:09:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:05.725332 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0b16-115d-4174-82ed-3cfb476b952e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:05.736541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f0b16-115d-4174-82ed-3cfb476b952e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:05.741039 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec948b-4403-423d-b841-2dfbaa88ca6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cccb32a47f7d4144b224d9fcc99091e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:05.741799 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec948b-4403-423d-b841-2dfbaa88ca6d service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:05.742228 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec948b-4403-423d-b841-2dfbaa88ca6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:05.742616 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec948b-4403-423d-b841-2dfbaa88ca6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:05.753262 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec948b-4403-423d-b841-2dfbaa88ca6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:05.754887 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec948b-4403-423d-b841-2dfbaa88ca6d service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:05.766028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 687/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:07.292666 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7e58-efed-4da1-afa5-42bdf137d88d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:07.293276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7e58-efed-4da1-afa5-42bdf137d88d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:07.293276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a7e58-efed-4da1-afa5-42bdf137d88d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:07.295203 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 690/1377] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:07.301743 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21e4e-5d1a-49ec-97dd-adaada03afc9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:07.302356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21e4e-5d1a-49ec-97dd-adaada03afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:07.302472 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb21e4e-5d1a-49ec-97dd-adaada03afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:07.321798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3cb21e4e-5d1a-49ec-97dd-adaada03afc9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:07.323072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3cb21e4e-5d1a-49ec-97dd-adaada03afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:07.331729 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 688/1378] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:07.378850 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7e58-efed-4da1-afa5-42bdf137d88d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:07.394939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a7e58-efed-4da1-afa5-42bdf137d88d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:07.400857 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c21637-a28c-413b-b0ae-8afde4897ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:07.401529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c21637-a28c-413b-b0ae-8afde4897ba8 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:07.401818 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c21637-a28c-413b-b0ae-8afde4897ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:07.402124 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c21637-a28c-413b-b0ae-8afde4897ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:07.411584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c21637-a28c-413b-b0ae-8afde4897ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:07.413236 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c21637-a28c-413b-b0ae-8afde4897ba8 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:07.424894 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 691/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:09.686752 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927fc2-40b9-45d8-9ef3-dd9952873948 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:09.687665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927fc2-40b9-45d8-9ef3-dd9952873948 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:09.687949 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee927fc2-40b9-45d8-9ef3-dd9952873948 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:09.689335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 689/1380] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:09.695007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c944e13-49c5-49dd-a340-1cc37ea28a14 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:09.695474 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c944e13-49c5-49dd-a340-1cc37ea28a14 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:09.695572 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c944e13-49c5-49dd-a340-1cc37ea28a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:09.716110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4c944e13-49c5-49dd-a340-1cc37ea28a14 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:09.717513 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4c944e13-49c5-49dd-a340-1cc37ea28a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:09.725290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 692/1381] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:09.769995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee927fc2-40b9-45d8-9ef3-dd9952873948 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:09.791942 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee927fc2-40b9-45d8-9ef3-dd9952873948 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:09.800315 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68df1b-9c3c-4023-9e21-54496bd1d1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:09.800962 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68df1b-9c3c-4023-9e21-54496bd1d1fe service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:09.801242 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68df1b-9c3c-4023-9e21-54496bd1d1fe service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:09.801513 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68df1b-9c3c-4023-9e21-54496bd1d1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:09.811710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68df1b-9c3c-4023-9e21-54496bd1d1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:09.813306 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68df1b-9c3c-4023-9e21-54496bd1d1fe service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:09.823258 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 690/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:12.084004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725ef1-e81a-468e-adab-d8a3cdf9ddd4 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:12.084636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725ef1-e81a-468e-adab-d8a3cdf9ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:12.084636 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725ef1-e81a-468e-adab-d8a3cdf9ddd4 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:12.085843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 693/1383] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:12.091717 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bfdd-34bc-4b2f-816c-c685ca519e3e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:12.092176 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bfdd-34bc-4b2f-816c-c685ca519e3e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:12.092401 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6bfdd-34bc-4b2f-816c-c685ca519e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:12.110920 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fbc6bfdd-34bc-4b2f-816c-c685ca519e3e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:12.112116 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fbc6bfdd-34bc-4b2f-816c-c685ca519e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:12.120200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 691/1384] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:09:12.161931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725ef1-e81a-468e-adab-d8a3cdf9ddd4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:12.177564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725ef1-e81a-468e-adab-d8a3cdf9ddd4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:12.182979 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d2d6f-d5fe-48b7-8491-e66a3358246e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:12.183637 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d2d6f-d5fe-48b7-8491-e66a3358246e service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:12.183907 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d2d6f-d5fe-48b7-8491-e66a3358246e service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:12.184181 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d2d6f-d5fe-48b7-8491-e66a3358246e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:12.193090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d2d6f-d5fe-48b7-8491-e66a3358246e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:12.194702 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d2d6f-d5fe-48b7-8491-e66a3358246e service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:12.204565 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 694/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:14.426433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc5ee-7464-4c3d-84ef-f14838753d02 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:14.427024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc5ee-7464-4c3d-84ef-f14838753d02 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:14.427304 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cc5ee-7464-4c3d-84ef-f14838753d02 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:14.429318 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 692/1386] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:14.435895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699a6c-f3e0-40ce-8df5-bd1cdabd3157 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:14.436342 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699a6c-f3e0-40ce-8df5-bd1cdabd3157 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:14.436439 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699a6c-f3e0-40ce-8df5-bd1cdabd3157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:14.454505 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-19699a6c-f3e0-40ce-8df5-bd1cdabd3157 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:14.455707 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-19699a6c-f3e0-40ce-8df5-bd1cdabd3157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:14.463947 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 695/1387] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:14.510632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cc5ee-7464-4c3d-84ef-f14838753d02 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:14.529661 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cc5ee-7464-4c3d-84ef-f14838753d02 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:14.535126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae664d2-a678-4218-b81f-96e06e850bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:14.535794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae664d2-a678-4218-b81f-96e06e850bce service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:14.536050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae664d2-a678-4218-b81f-96e06e850bce service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:14.536327 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae664d2-a678-4218-b81f-96e06e850bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:14.546650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae664d2-a678-4218-b81f-96e06e850bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:14.548251 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae664d2-a678-4218-b81f-96e06e850bce service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:14.557802 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 693/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:16.801672 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2850a4-c960-4ccf-a1c6-5409137a347b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:16.802145 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2850a4-c960-4ccf-a1c6-5409137a347b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:16.802509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2850a4-c960-4ccf-a1c6-5409137a347b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:16.804304 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 696/1389] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:16.810779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358be0-b3b9-4270-8318-4fa32010d08b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:16.811333 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358be0-b3b9-4270-8318-4fa32010d08b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:16.811505 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358be0-b3b9-4270-8318-4fa32010d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:16.834639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-61358be0-b3b9-4270-8318-4fa32010d08b None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:16.836265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-61358be0-b3b9-4270-8318-4fa32010d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:16.847066 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 694/1390] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:16.902453 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2850a4-c960-4ccf-a1c6-5409137a347b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:16.917389 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2850a4-c960-4ccf-a1c6-5409137a347b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:16.925385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963f2dc-94b4-43f6-a5b1-cd6b6c06200c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:16.926021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f2dc-94b4-43f6-a5b1-cd6b6c06200c service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:16.926138 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f2dc-94b4-43f6-a5b1-cd6b6c06200c service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:16.926405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f2dc-94b4-43f6-a5b1-cd6b6c06200c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:16.937038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f2dc-94b4-43f6-a5b1-cd6b6c06200c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:16.938783 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f2dc-94b4-43f6-a5b1-cd6b6c06200c service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:16.948976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 697/1391] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 09:09:19.805422 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4eb86-9729-4699-a5e7-3a43740e31f6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:19.805987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4eb86-9729-4699-a5e7-3a43740e31f6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:19.806102 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4eb86-9729-4699-a5e7-3a43740e31f6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:19.807378 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 695/1392] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:19.812896 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2766-550f-4837-a87c-4385b00bbc61 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:19.813373 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2766-550f-4837-a87c-4385b00bbc61 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:19.813478 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2766-550f-4837-a87c-4385b00bbc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:19.832053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ad3d2766-550f-4837-a87c-4385b00bbc61 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:19.833258 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ad3d2766-550f-4837-a87c-4385b00bbc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:19.841970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 698/1393] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:19.884481 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4eb86-9729-4699-a5e7-3a43740e31f6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:19.899780 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4eb86-9729-4699-a5e7-3a43740e31f6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:19.906026 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274136f-9ab1-45cb-aba6-c8c089f1a2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:19.906695 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274136f-9ab1-45cb-aba6-c8c089f1a2b0 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:19.906958 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274136f-9ab1-45cb-aba6-c8c089f1a2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:19.907234 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274136f-9ab1-45cb-aba6-c8c089f1a2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:19.915932 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274136f-9ab1-45cb-aba6-c8c089f1a2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:19.917533 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274136f-9ab1-45cb-aba6-c8c089f1a2b0 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:19.927390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 696/1394] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:21.966531 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff500-1cef-4ed3-8b6d-74dd6756a66d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:21.967329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff500-1cef-4ed3-8b6d-74dd6756a66d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:21.967329 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff500-1cef-4ed3-8b6d-74dd6756a66d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:21.968551 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 699/1395] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:21.974673 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aff32-62e6-425f-9846-16487df298c3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:21.975230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aff32-62e6-425f-9846-16487df298c3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:21.975230 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aff32-62e6-425f-9846-16487df298c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:21.981301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=52 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:09:21.994827 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e54aff32-62e6-425f-9846-16487df298c3 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:21.996015 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e54aff32-62e6-425f-9846-16487df298c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:22.005098 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 697/1396] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:22.060887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097da91-9a3e-42a2-9689-fd3a923156f8 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.061253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097da91-9a3e-42a2-9689-fd3a923156f8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.061537 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097da91-9a3e-42a2-9689-fd3a923156f8 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.063098 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 700/1397] 10.222.0.30 () {54 vars in 962 bytes} [Tue May 24 09:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:22.070480 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.070776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.071061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.120808 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] MFA Rules not processed for user `7c8d51e0bff14ada928537dafdb67654`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:22.122739 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:22.149681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0df5a-fa0e-4423-aa9b-447573d803d5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.150009 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0df5a-fa0e-4423-aa9b-447573d803d5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.150398 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0df5a-fa0e-4423-aa9b-447573d803d5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.151805 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 701/1398] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:09:22.157006 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.157300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.157580 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.175808 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:22.177277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:22.186061 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 698/1399] 10.222.0.30 () {58 vars in 1059 bytes} [Tue May 24 09:09:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:09:22.186324 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 702/1400] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:09:22.194092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:22.201707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9cd7-8698-4be6-8c89-8c2309135c24 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:22.205344 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa3d9-4d21-4ead-a15d-6ea3331a65bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c8d51e0bff14ada928537dafdb67654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:22.206002 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa3d9-4d21-4ead-a15d-6ea3331a65bb service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.206284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa3d9-4d21-4ead-a15d-6ea3331a65bb service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.206557 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa3d9-4d21-4ead-a15d-6ea3331a65bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.215432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaa3d9-4d21-4ead-a15d-6ea3331a65bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:22.216953 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaa3d9-4d21-4ead-a15d-6ea3331a65bb service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:22.226514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 699/1401] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:22.229799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:22.243801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd666-237d-4f04-afde-09c2b2ce1cbd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:22.251032 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1f1e-f288-4cfe-8b43-943f885a6cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:22.251767 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1f1e-f288-4cfe-8b43-943f885a6cd5 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.252197 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1f1e-f288-4cfe-8b43-943f885a6cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.252603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1f1e-f288-4cfe-8b43-943f885a6cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.262384 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1f1e-f288-4cfe-8b43-943f885a6cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:22.264175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1f1e-f288-4cfe-8b43-943f885a6cd5 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:22.277984 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 703/1402] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:22.794016 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c91f8-e5ba-4a8f-a47c-715475814802 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.794856 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c91f8-e5ba-4a8f-a47c-715475814802 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.795121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c91f8-e5ba-4a8f-a47c-715475814802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.845363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ae0c91f8-e5ba-4a8f-a47c-715475814802 None None] MFA Rules not processed for user `ac1aee8389d44275a5f0ffe6d971d349`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:22.846596 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ae0c91f8-e5ba-4a8f-a47c-715475814802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:22.911508 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 700/1403] 10.222.0.30 () {58 vars in 1009 bytes} [Tue May 24 09:09:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:22.953789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e253-f677-44fc-9147-1b4410aac027 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.954217 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e253-f677-44fc-9147-1b4410aac027 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.954529 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e253-f677-44fc-9147-1b4410aac027 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:22.956057 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 704/1404] 10.222.0.30 () {54 vars in 942 bytes} [Tue May 24 09:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:22.962702 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae861d-e33f-4d42-b5ee-91625007a27b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:22.962996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae861d-e33f-4d42-b5ee-91625007a27b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:22.963280 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae861d-e33f-4d42-b5ee-91625007a27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:23.009291 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:09:23.013109 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-35ae861d-e33f-4d42-b5ee-91625007a27b None None] MFA Rules not processed for user `cda4a224028a47f9afef8b443eb59a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:23.014906 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-35ae861d-e33f-4d42-b5ee-91625007a27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:23.088054 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 701/1405] 10.222.0.30 () {58 vars in 1039 bytes} [Tue May 24 09:09:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:23.098132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e253-f677-44fc-9147-1b4410aac027 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:23.111610 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e253-f677-44fc-9147-1b4410aac027 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:23.116536 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da148-02be-4400-ae6d-cd0746440baf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda4a224028a47f9afef8b443eb59a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:23.117178 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da148-02be-4400-ae6d-cd0746440baf service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:23.117462 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da148-02be-4400-ae6d-cd0746440baf service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:23.117737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da148-02be-4400-ae6d-cd0746440baf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:23.126016 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da148-02be-4400-ae6d-cd0746440baf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:23.127598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da148-02be-4400-ae6d-cd0746440baf service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:23.135972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 705/1406] 10.222.0.30 () {60 vars in 1384 bytes} [Tue May 24 09:09:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 09:09:24.572200 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8001a-95e2-4c52-8f9d-e2d1739b3e94 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:24.572776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8001a-95e2-4c52-8f9d-e2d1739b3e94 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:24.572776 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8001a-95e2-4c52-8f9d-e2d1739b3e94 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:24.574122 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 702/1407] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:24.580322 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13cc1f-38e9-4dbc-845a-3a3dcc437488 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:24.581183 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13cc1f-38e9-4dbc-845a-3a3dcc437488 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:24.581673 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13cc1f-38e9-4dbc-845a-3a3dcc437488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:24.601266 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bb13cc1f-38e9-4dbc-845a-3a3dcc437488 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:24.602502 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bb13cc1f-38e9-4dbc-845a-3a3dcc437488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:24.613685 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 706/1408] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:24.661012 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8001a-95e2-4c52-8f9d-e2d1739b3e94 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:24.677587 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8001a-95e2-4c52-8f9d-e2d1739b3e94 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:24.685405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f965a6-78be-4bf2-9e4e-799569ce4485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:24.686117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f965a6-78be-4bf2-9e4e-799569ce4485 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:24.686406 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f965a6-78be-4bf2-9e4e-799569ce4485 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:24.686719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f965a6-78be-4bf2-9e4e-799569ce4485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:24.696035 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f965a6-78be-4bf2-9e4e-799569ce4485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:24.698994 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f965a6-78be-4bf2-9e4e-799569ce4485 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:24.710028 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 703/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:34.595361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=81 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:09:34.705597 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=36 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:09:46.652039 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee3be3-567e-4a3a-95ad-44a1522e05a5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:46.652678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee3be3-567e-4a3a-95ad-44a1522e05a5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:46.652678 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee3be3-567e-4a3a-95ad-44a1522e05a5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:46.654538 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 707/1410] 10.222.0.30 () {54 vars in 918 bytes} [Tue May 24 09:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:46.659555 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3409-c8f6-4d92-ab58-3120c57377af None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:46.660032 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3409-c8f6-4d92-ab58-3120c57377af None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:46.660140 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3409-c8f6-4d92-ab58-3120c57377af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:46.678833 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7c4a3409-c8f6-4d92-ab58-3120c57377af None None] MFA Rules not processed for user `c279c9b085cf4ed29beb47b720834165`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:46.680022 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7c4a3409-c8f6-4d92-ab58-3120c57377af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:46.688573 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 704/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Tue May 24 09:09:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:09:46.702587 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f51b2-104d-4fed-a656-b00a6e083d51 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:46.702951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f51b2-104d-4fed-a656-b00a6e083d51 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:46.703278 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f51b2-104d-4fed-a656-b00a6e083d51 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:46.704664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 708/1412] 10.222.0.30 () {54 vars in 918 bytes} [Tue May 24 09:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:46.709075 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c546c-de40-4cdf-be2e-1e4283282000 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:46.709370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c546c-de40-4cdf-be2e-1e4283282000 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:46.709649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c546c-de40-4cdf-be2e-1e4283282000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:46.728009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-884c546c-de40-4cdf-be2e-1e4283282000 None None] MFA Rules not processed for user `10ba53ef4d604f33aa31e50d053f3641`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:46.729196 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-884c546c-de40-4cdf-be2e-1e4283282000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:46.738900 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 705/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Tue May 24 09:09:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:49.400044 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95484-1adc-4e8c-a018-5e4580637fda None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:49.400629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95484-1adc-4e8c-a018-5e4580637fda None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:49.400629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95484-1adc-4e8c-a018-5e4580637fda None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:49.401980 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:49.408064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb05f-f51d-46ee-917a-91487f13deb5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:49.408499 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb05f-f51d-46ee-917a-91487f13deb5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:49.408626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0deb05f-f51d-46ee-917a-91487f13deb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:49.426245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d0deb05f-f51d-46ee-917a-91487f13deb5 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:49.427433 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d0deb05f-f51d-46ee-917a-91487f13deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:49.435539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:49.477801 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95484-1adc-4e8c-a018-5e4580637fda None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:49.492345 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95484-1adc-4e8c-a018-5e4580637fda None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:49.498400 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e19ba-9ba9-4a16-ad02-e966729d97db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:49.499034 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e19ba-9ba9-4a16-ad02-e966729d97db service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:49.499319 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e19ba-9ba9-4a16-ad02-e966729d97db service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:49.499597 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e19ba-9ba9-4a16-ad02-e966729d97db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:49.507679 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e19ba-9ba9-4a16-ad02-e966729d97db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:49.509249 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e19ba-9ba9-4a16-ad02-e966729d97db service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:49.519316 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 710/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:50.489581 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04329d53-7f89-43a0-b6e1-af63ee16fe0f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:50.490183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04329d53-7f89-43a0-b6e1-af63ee16fe0f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:50.490183 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04329d53-7f89-43a0-b6e1-af63ee16fe0f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:50.491532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:50.496416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9feca1-df8e-4db7-9191-bf4418447d63 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:50.497230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9feca1-df8e-4db7-9191-bf4418447d63 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:50.497517 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9feca1-df8e-4db7-9191-bf4418447d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:50.515441 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0f9feca1-df8e-4db7-9191-bf4418447d63 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:50.516617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0f9feca1-df8e-4db7-9191-bf4418447d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:50.524297 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:50.691770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04329d53-7f89-43a0-b6e1-af63ee16fe0f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:50.706354 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04329d53-7f89-43a0-b6e1-af63ee16fe0f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:50.711632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b500bc-2775-4fad-8d1b-3de69ecabcc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:50.712263 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b500bc-2775-4fad-8d1b-3de69ecabcc4 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:50.712547 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b500bc-2775-4fad-8d1b-3de69ecabcc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:50.712823 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b500bc-2775-4fad-8d1b-3de69ecabcc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:50.721492 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b500bc-2775-4fad-8d1b-3de69ecabcc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:50.723112 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b500bc-2775-4fad-8d1b-3de69ecabcc4 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:50.732710 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 708/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:51.655072 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb89dee-985e-4c63-9492-4b6755245bfc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:51.655653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb89dee-985e-4c63-9492-4b6755245bfc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:51.655653 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb89dee-985e-4c63-9492-4b6755245bfc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:51.657038 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:51.662126 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af964c-270a-43cc-ba3a-4c26f6e515df None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:51.662583 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af964c-270a-43cc-ba3a-4c26f6e515df None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:51.662689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af964c-270a-43cc-ba3a-4c26f6e515df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:51.681110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-82af964c-270a-43cc-ba3a-4c26f6e515df None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:51.682352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-82af964c-270a-43cc-ba3a-4c26f6e515df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:51.690715 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:51.840130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb89dee-985e-4c63-9492-4b6755245bfc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:51.854698 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb89dee-985e-4c63-9492-4b6755245bfc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:51.860936 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18342282-ff43-4d42-9aef-09b5afa6ed38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:51.861570 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18342282-ff43-4d42-9aef-09b5afa6ed38 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:51.861865 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18342282-ff43-4d42-9aef-09b5afa6ed38 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:51.862157 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18342282-ff43-4d42-9aef-09b5afa6ed38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:51.870264 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18342282-ff43-4d42-9aef-09b5afa6ed38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:51.871959 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18342282-ff43-4d42-9aef-09b5afa6ed38 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:51.881155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 713/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:52.794797 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f886f-ddc5-4167-9e3e-01d43f507bb3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:52.795305 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f886f-ddc5-4167-9e3e-01d43f507bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:52.795405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f886f-ddc5-4167-9e3e-01d43f507bb3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:52.796713 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:09:52.801956 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6e179-c5d4-44f7-9f32-0e0426f5d1cc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:52.802386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6e179-c5d4-44f7-9f32-0e0426f5d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:52.802548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6e179-c5d4-44f7-9f32-0e0426f5d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:52.820410 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5bf6e179-c5d4-44f7-9f32-0e0426f5d1cc None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:52.821603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5bf6e179-c5d4-44f7-9f32-0e0426f5d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:52.830385 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:52.982822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f886f-ddc5-4167-9e3e-01d43f507bb3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:52.997162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f886f-ddc5-4167-9e3e-01d43f507bb3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:53.002479 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68267b-316a-4b3f-869a-f915da30410a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:53.003105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68267b-316a-4b3f-869a-f915da30410a service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:53.003390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68267b-316a-4b3f-869a-f915da30410a service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:53.003668 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68267b-316a-4b3f-869a-f915da30410a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:53.011680 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68267b-316a-4b3f-869a-f915da30410a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:53.013930 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68267b-316a-4b3f-869a-f915da30410a service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:53.023163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 711/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:53.924487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58c68-b325-47c0-b5a7-86628e318ec6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:53.925026 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58c68-b325-47c0-b5a7-86628e318ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:53.925026 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58c68-b325-47c0-b5a7-86628e318ec6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:53.926510 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:53.931428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7abb5a-10ba-4baa-9ab0-f10fb2a713ec None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:53.931878 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7abb5a-10ba-4baa-9ab0-f10fb2a713ec None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:53.932064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7abb5a-10ba-4baa-9ab0-f10fb2a713ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:53.951174 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7b7abb5a-10ba-4baa-9ab0-f10fb2a713ec None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:53.952351 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7b7abb5a-10ba-4baa-9ab0-f10fb2a713ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:53.960041 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:54.110345 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58c68-b325-47c0-b5a7-86628e318ec6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:54.124618 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58c68-b325-47c0-b5a7-86628e318ec6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:54.130022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc8775-8264-431f-ab40-b01c18bbfc02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:54.130664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8775-8264-431f-ab40-b01c18bbfc02 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:54.130951 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8775-8264-431f-ab40-b01c18bbfc02 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:54.131233 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc8775-8264-431f-ab40-b01c18bbfc02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:54.139460 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc8775-8264-431f-ab40-b01c18bbfc02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:54.141058 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc8775-8264-431f-ab40-b01c18bbfc02 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:54.150487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 716/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:55.002356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc3ed1-a10e-4589-bd59-e65761137b0b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:55.002894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc3ed1-a10e-4589-bd59-e65761137b0b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:55.002894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc3ed1-a10e-4589-bd59-e65761137b0b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:55.004288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:55.009352 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e33c0-92a7-479e-9144-6e4d5f040e46 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:55.009782 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e33c0-92a7-479e-9144-6e4d5f040e46 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:55.009972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e33c0-92a7-479e-9144-6e4d5f040e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:55.028609 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ac4e33c0-92a7-479e-9144-6e4d5f040e46 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:55.029811 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ac4e33c0-92a7-479e-9144-6e4d5f040e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:55.037527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:55.186794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc3ed1-a10e-4589-bd59-e65761137b0b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:55.200897 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc3ed1-a10e-4589-bd59-e65761137b0b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:55.206240 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3536-505d-46b3-a7b7-a853e8a259f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:55.206872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3536-505d-46b3-a7b7-a853e8a259f6 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:55.207164 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3536-505d-46b3-a7b7-a853e8a259f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:55.207443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3536-505d-46b3-a7b7-a853e8a259f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:55.215541 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3536-505d-46b3-a7b7-a853e8a259f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:55.217121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3536-505d-46b3-a7b7-a853e8a259f6 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:55.226443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 714/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:56.073480 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42fa20-5b27-4bd6-b42a-922edf9f5dc3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:56.074081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42fa20-5b27-4bd6-b42a-922edf9f5dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:56.074081 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42fa20-5b27-4bd6-b42a-922edf9f5dc3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:56.075882 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:56.080912 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f137-fed2-49b3-b9f0-868f7aece048 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:56.081431 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f137-fed2-49b3-b9f0-868f7aece048 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:56.081822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f137-fed2-49b3-b9f0-868f7aece048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:56.102187 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0fc9f137-fed2-49b3-b9f0-868f7aece048 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:56.103385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0fc9f137-fed2-49b3-b9f0-868f7aece048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:56.111267 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:56.262673 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42fa20-5b27-4bd6-b42a-922edf9f5dc3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:56.277064 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42fa20-5b27-4bd6-b42a-922edf9f5dc3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:56.283064 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69790-da83-48d5-8045-e6f4105ad179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:56.283723 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69790-da83-48d5-8045-e6f4105ad179 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:56.284005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69790-da83-48d5-8045-e6f4105ad179 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:56.284277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69790-da83-48d5-8045-e6f4105ad179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:56.292603 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69790-da83-48d5-8045-e6f4105ad179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:56.294790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69790-da83-48d5-8045-e6f4105ad179 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:56.310384 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 719/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:57.164869 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8178b-dc5f-4386-9b2a-aede388ba699 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:57.165654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8178b-dc5f-4386-9b2a-aede388ba699 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:57.165654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8178b-dc5f-4386-9b2a-aede388ba699 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:57.167008 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:57.172564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93db041-281d-4df4-bfd5-b10a694a2778 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:57.173005 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93db041-281d-4df4-bfd5-b10a694a2778 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:57.173127 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93db041-281d-4df4-bfd5-b10a694a2778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:57.191126 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a93db041-281d-4df4-bfd5-b10a694a2778 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:57.192323 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a93db041-281d-4df4-bfd5-b10a694a2778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:57.200113 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:57.348872 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8178b-dc5f-4386-9b2a-aede388ba699 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:57.364121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8178b-dc5f-4386-9b2a-aede388ba699 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:57.369657 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c19a9-9d51-4468-82a3-603fe75615ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:57.370667 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c19a9-9d51-4468-82a3-603fe75615ee service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:57.371009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c19a9-9d51-4468-82a3-603fe75615ee service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:57.371369 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c19a9-9d51-4468-82a3-603fe75615ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:57.380568 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c19a9-9d51-4468-82a3-603fe75615ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:57.382208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c19a9-9d51-4468-82a3-603fe75615ee service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:57.392226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 717/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:09:58.250768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405daf-d296-4a2d-aae0-4605a4360855 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:58.251314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405daf-d296-4a2d-aae0-4605a4360855 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:58.251314 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405daf-d296-4a2d-aae0-4605a4360855 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:58.252689 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:09:58.257756 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3be65-cd8a-4867-bd63-327f8b3933a7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:58.258199 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3be65-cd8a-4867-bd63-327f8b3933a7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:58.258355 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3be65-cd8a-4867-bd63-327f8b3933a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:58.280361 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-46d3be65-cd8a-4867-bd63-327f8b3933a7 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:09:58.281561 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-46d3be65-cd8a-4867-bd63-327f8b3933a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:09:58.289335 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:09:58.437720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405daf-d296-4a2d-aae0-4605a4360855 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:09:58.452934 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405daf-d296-4a2d-aae0-4605a4360855 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:09:58.458247 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f3ac0-958c-4d10-93e3-fb2f597edacc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:09:58.458878 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f3ac0-958c-4d10-93e3-fb2f597edacc service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:09:58.459161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f3ac0-958c-4d10-93e3-fb2f597edacc service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:09:58.459437 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f3ac0-958c-4d10-93e3-fb2f597edacc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:09:58.467590 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f3ac0-958c-4d10-93e3-fb2f597edacc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:09:58.469167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f3ac0-958c-4d10-93e3-fb2f597edacc service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:09:58.478335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 722/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:00.547352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb46fa-3a98-4ed0-b045-3914280e222e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:00.547859 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb46fa-3a98-4ed0-b045-3914280e222e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:00.547960 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb46fa-3a98-4ed0-b045-3914280e222e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:00.549278 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:00.554598 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21605-210f-4c3d-950b-e8e59ac09b1d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:00.555019 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21605-210f-4c3d-950b-e8e59ac09b1d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:00.555156 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c21605-210f-4c3d-950b-e8e59ac09b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:00.576312 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e7c21605-210f-4c3d-950b-e8e59ac09b1d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:00.577509 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e7c21605-210f-4c3d-950b-e8e59ac09b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:00.585315 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:00.624326 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb46fa-3a98-4ed0-b045-3914280e222e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:00.626047 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-56eb46fa-3a98-4ed0-b045-3914280e222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:00.639010 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb46fa-3a98-4ed0-b045-3914280e222e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:00.642535 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f36f99-4d9a-44f6-a118-d2d8788bd2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:00.643172 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36f99-4d9a-44f6-a118-d2d8788bd2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:00.643456 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36f99-4d9a-44f6-a118-d2d8788bd2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:00.643732 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f36f99-4d9a-44f6-a118-d2d8788bd2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:00.652469 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f36f99-4d9a-44f6-a118-d2d8788bd2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:00.653896 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f36f99-4d9a-44f6-a118-d2d8788bd2ca service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:00.663146 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 720/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:03.019964 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36c94-13e5-4fac-9d44-31a89b121cf2 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:03.020487 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36c94-13e5-4fac-9d44-31a89b121cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:03.020584 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36c94-13e5-4fac-9d44-31a89b121cf2 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:03.021923 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:03.027246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403053-326e-47f1-889f-aaf5ed613110 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:03.028731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403053-326e-47f1-889f-aaf5ed613110 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:03.028731 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35403053-326e-47f1-889f-aaf5ed613110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:03.047034 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-35403053-326e-47f1-889f-aaf5ed613110 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:03.048169 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-35403053-326e-47f1-889f-aaf5ed613110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:03.055899 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:03.093209 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d36c94-13e5-4fac-9d44-31a89b121cf2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:03.104231 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d36c94-13e5-4fac-9d44-31a89b121cf2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:03.108395 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a65d5-00ed-4fab-8dbc-256eb283a2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:03.109067 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a65d5-00ed-4fab-8dbc-256eb283a2db service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:03.109386 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a65d5-00ed-4fab-8dbc-256eb283a2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:03.109697 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a65d5-00ed-4fab-8dbc-256eb283a2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:03.118751 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a65d5-00ed-4fab-8dbc-256eb283a2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:03.120184 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a65d5-00ed-4fab-8dbc-256eb283a2db service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:03.130166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 725/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:05.658614 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff302e-f714-4aea-90c4-1c0f8bf6bd03 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:05.659162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff302e-f714-4aea-90c4-1c0f8bf6bd03 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:05.659162 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff302e-f714-4aea-90c4-1c0f8bf6bd03 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:05.660592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:05.665990 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e78c1-f83a-409e-bfed-381729eb8d90 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:05.666405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e78c1-f83a-409e-bfed-381729eb8d90 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:05.666539 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e78c1-f83a-409e-bfed-381729eb8d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:05.684709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-603e78c1-f83a-409e-bfed-381729eb8d90 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:05.685895 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-603e78c1-f83a-409e-bfed-381729eb8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:05.693504 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:05.733077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff302e-f714-4aea-90c4-1c0f8bf6bd03 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:05.748307 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff302e-f714-4aea-90c4-1c0f8bf6bd03 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:05.751796 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00194a-77a6-43a4-95aa-2b9289a5db84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:05.752425 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00194a-77a6-43a4-95aa-2b9289a5db84 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:05.752708 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00194a-77a6-43a4-95aa-2b9289a5db84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:05.752981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00194a-77a6-43a4-95aa-2b9289a5db84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:05.761704 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00194a-77a6-43a4-95aa-2b9289a5db84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:05.764180 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00194a-77a6-43a4-95aa-2b9289a5db84 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:05.773355 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 723/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:08.170418 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326f50-755d-4213-b2d5-edda1a627b01 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:08.171007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326f50-755d-4213-b2d5-edda1a627b01 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:08.171007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2326f50-755d-4213-b2d5-edda1a627b01 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:08.172277 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:08.177563 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff52c5-5e26-4a84-b21b-04d1ab0a0135 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:08.178005 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff52c5-5e26-4a84-b21b-04d1ab0a0135 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:08.178151 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff52c5-5e26-4a84-b21b-04d1ab0a0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:08.196021 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-88ff52c5-5e26-4a84-b21b-04d1ab0a0135 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:08.197212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-88ff52c5-5e26-4a84-b21b-04d1ab0a0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:08.205723 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:08.243093 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2326f50-755d-4213-b2d5-edda1a627b01 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:08.254430 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2326f50-755d-4213-b2d5-edda1a627b01 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:08.257978 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c1d01-a991-4615-8132-3bb899896ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:08.258615 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c1d01-a991-4615-8132-3bb899896ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:08.258903 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c1d01-a991-4615-8132-3bb899896ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:08.259180 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c1d01-a991-4615-8132-3bb899896ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:08.271326 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c1d01-a991-4615-8132-3bb899896ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:08.272790 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c1d01-a991-4615-8132-3bb899896ba3 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:08.282566 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 728/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:10.515355 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d208-0542-4136-be37-b087b3bc5607 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:10.515935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d208-0542-4136-be37-b087b3bc5607 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:10.515935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541d208-0542-4136-be37-b087b3bc5607 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:10.517265 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:10.522641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0051-dc2d-4ac4-9b6b-fc42717b99b9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:10.523071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0051-dc2d-4ac4-9b6b-fc42717b99b9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:10.523212 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a0051-dc2d-4ac4-9b6b-fc42717b99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:10.541718 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ed0a0051-dc2d-4ac4-9b6b-fc42717b99b9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:10.542985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ed0a0051-dc2d-4ac4-9b6b-fc42717b99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:10.551594 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:10.588981 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d208-0542-4136-be37-b087b3bc5607 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:10.600235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541d208-0542-4136-be37-b087b3bc5607 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:10.603777 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952b1de-61e0-4ec2-9ebf-569fed204949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:10.604409 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952b1de-61e0-4ec2-9ebf-569fed204949 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:10.604693 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952b1de-61e0-4ec2-9ebf-569fed204949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:10.604999 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952b1de-61e0-4ec2-9ebf-569fed204949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:10.614903 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952b1de-61e0-4ec2-9ebf-569fed204949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:10.616375 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952b1de-61e0-4ec2-9ebf-569fed204949 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:10.625879 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 726/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 09:10:12.913859 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6fd2d-994c-4611-b608-13a387980abf None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:12.914461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6fd2d-994c-4611-b608-13a387980abf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:12.914461 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6fd2d-994c-4611-b608-13a387980abf None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:12.916079 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:12.922341 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec202e-7fbd-4404-80d7-7b771d95dc04 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:12.922754 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec202e-7fbd-4404-80d7-7b771d95dc04 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:12.922961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec202e-7fbd-4404-80d7-7b771d95dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:12.941067 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-efec202e-7fbd-4404-80d7-7b771d95dc04 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:12.942298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-efec202e-7fbd-4404-80d7-7b771d95dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:12.950632 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:12.987131 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6fd2d-994c-4611-b608-13a387980abf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:12.998623 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6fd2d-994c-4611-b608-13a387980abf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:13.002304 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaebf9-4221-4188-be33-82fa32381d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:13.003995 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaebf9-4221-4188-be33-82fa32381d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:13.004339 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaebf9-4221-4188-be33-82fa32381d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:13.004624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaebf9-4221-4188-be33-82fa32381d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:13.014276 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaebf9-4221-4188-be33-82fa32381d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:13.015722 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaebf9-4221-4188-be33-82fa32381d16 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:13.025110 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 731/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:15.272935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea46e-dba0-4956-9e32-45a60337c0f0 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:15.273494 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea46e-dba0-4956-9e32-45a60337c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:15.273606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea46e-dba0-4956-9e32-45a60337c0f0 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:15.274940 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:15.280691 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074704-d3e9-4cac-97e2-0a41d31470ce None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:15.281118 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074704-d3e9-4cac-97e2-0a41d31470ce None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:15.281253 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074704-d3e9-4cac-97e2-0a41d31470ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:15.287298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=70 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:10:15.300872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a6074704-d3e9-4cac-97e2-0a41d31470ce None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:15.302108 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a6074704-d3e9-4cac-97e2-0a41d31470ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:15.310007 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:15.347374 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea46e-dba0-4956-9e32-45a60337c0f0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:15.352779 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=73 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:10:15.359806 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea46e-dba0-4956-9e32-45a60337c0f0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:15.363246 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9321b90-50e1-4cf4-864c-45d6442e512c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:15.363871 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9321b90-50e1-4cf4-864c-45d6442e512c service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:15.364152 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9321b90-50e1-4cf4-864c-45d6442e512c service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:15.364428 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9321b90-50e1-4cf4-864c-45d6442e512c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:15.373358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9321b90-50e1-4cf4-864c-45d6442e512c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:15.374819 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9321b90-50e1-4cf4-864c-45d6442e512c service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:15.383976 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 729/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:17.635311 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7389-d81e-46d8-b3fd-c50a37fbdfcb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:17.635881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7389-d81e-46d8-b3fd-c50a37fbdfcb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:17.635881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7389-d81e-46d8-b3fd-c50a37fbdfcb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:17.637334 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:17.642778 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5fa07-7df2-4c70-964b-4f6a646de56e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:17.643197 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5fa07-7df2-4c70-964b-4f6a646de56e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:17.643342 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5fa07-7df2-4c70-964b-4f6a646de56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:17.661310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-51e5fa07-7df2-4c70-964b-4f6a646de56e None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:17.662549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-51e5fa07-7df2-4c70-964b-4f6a646de56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:17.671085 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:17.710877 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7389-d81e-46d8-b3fd-c50a37fbdfcb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:17.723335 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7389-d81e-46d8-b3fd-c50a37fbdfcb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:17.726816 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e986-3db9-4b8f-8880-18fd8981f6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:17.727452 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e986-3db9-4b8f-8880-18fd8981f6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:17.727735 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e986-3db9-4b8f-8880-18fd8981f6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:17.728013 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e986-3db9-4b8f-8880-18fd8981f6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:17.737506 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80e986-3db9-4b8f-8880-18fd8981f6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:17.738977 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80e986-3db9-4b8f-8880-18fd8981f6b7 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:17.749020 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 734/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:20.102390 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b571-a2b1-4692-9338-da205d8a5dfa None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:20.102840 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b571-a2b1-4692-9338-da205d8a5dfa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:20.102945 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591b571-a2b1-4692-9338-da205d8a5dfa None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:20.104310 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:20.110260 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a359b-faa3-4cb0-a156-9f1b308b8ed6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:20.110655 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a359b-faa3-4cb0-a156-9f1b308b8ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:20.111133 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a359b-faa3-4cb0-a156-9f1b308b8ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:20.128976 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8d0a359b-faa3-4cb0-a156-9f1b308b8ed6 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:20.130234 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8d0a359b-faa3-4cb0-a156-9f1b308b8ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:20.138004 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:20.173987 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b571-a2b1-4692-9338-da205d8a5dfa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:20.185607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591b571-a2b1-4692-9338-da205d8a5dfa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:20.189077 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbdbff-f8f8-4fb3-821f-40b3246bbe09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:20.189701 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdbff-f8f8-4fb3-821f-40b3246bbe09 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:20.190024 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdbff-f8f8-4fb3-821f-40b3246bbe09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:20.190298 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdbff-f8f8-4fb3-821f-40b3246bbe09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:20.199038 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbdbff-f8f8-4fb3-821f-40b3246bbe09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:20.201096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbdbff-f8f8-4fb3-821f-40b3246bbe09 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:20.210324 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 732/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:22.429095 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d260-766e-4d49-ba50-8c1076a4af9a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:22.429728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d260-766e-4d49-ba50-8c1076a4af9a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:22.429728 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d260-766e-4d49-ba50-8c1076a4af9a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:22.431391 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:22.437935 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110549d-08cd-458e-b798-7c2a37f32fdb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:22.438426 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110549d-08cd-458e-b798-7c2a37f32fdb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:22.438532 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110549d-08cd-458e-b798-7c2a37f32fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:22.455876 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2110549d-08cd-458e-b798-7c2a37f32fdb None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:22.457063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2110549d-08cd-458e-b798-7c2a37f32fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:22.465367 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:22.501931 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d260-766e-4d49-ba50-8c1076a4af9a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:22.512855 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d260-766e-4d49-ba50-8c1076a4af9a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:22.516306 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f8607-e0da-4b7c-b122-0d19cee1ff30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:22.516939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8607-e0da-4b7c-b122-0d19cee1ff30 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:22.517219 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8607-e0da-4b7c-b122-0d19cee1ff30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:22.517508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f8607-e0da-4b7c-b122-0d19cee1ff30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:22.526166 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f8607-e0da-4b7c-b122-0d19cee1ff30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:22.528527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f8607-e0da-4b7c-b122-0d19cee1ff30 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:22.538090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 737/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:32.455107 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=17 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:10:32.533659 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=17 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:10:55.602699 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453b9b-bb89-4951-ac23-d0a004840456 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:55.603319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453b9b-bb89-4951-ac23-d0a004840456 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:55.603319 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453b9b-bb89-4951-ac23-d0a004840456 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:55.604740 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 734/1471] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:55.610331 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281c6a-bc48-4ef0-8f78-331429d37a58 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:55.610812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281c6a-bc48-4ef0-8f78-331429d37a58 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:55.610918 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281c6a-bc48-4ef0-8f78-331429d37a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:55.628900 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-89281c6a-bc48-4ef0-8f78-331429d37a58 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:55.630130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89281c6a-bc48-4ef0-8f78-331429d37a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:55.642242 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 738/1472] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:55.688552 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c86a1b-29f8-4ccc-8835-7b4fc61cfa8f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:55.688841 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c86a1b-29f8-4ccc-8835-7b4fc61cfa8f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:55.689121 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c86a1b-29f8-4ccc-8835-7b4fc61cfa8f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:55.690572 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 735/1473] 10.222.0.30 () {54 vars in 962 bytes} [Tue May 24 09:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:55.695230 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ca6d-40be-444b-838d-e2c79bc8674f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:55.695548 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ca6d-40be-444b-838d-e2c79bc8674f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:55.695829 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ca6d-40be-444b-838d-e2c79bc8674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:55.714642 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7482ca6d-40be-444b-838d-e2c79bc8674f None None] MFA Rules not processed for user `7c8d51e0bff14ada928537dafdb67654`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:55.715814 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7482ca6d-40be-444b-838d-e2c79bc8674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:55.722202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 739/1474] 10.222.0.30 () {58 vars in 1059 bytes} [Tue May 24 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:55.729249 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c86a1b-29f8-4ccc-8835-7b4fc61cfa8f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:55.739770 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c86a1b-29f8-4ccc-8835-7b4fc61cfa8f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:55.743269 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e02c8f-db2f-4c87-b816-17bfc57bfe49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c8d51e0bff14ada928537dafdb67654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:55.743894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e02c8f-db2f-4c87-b816-17bfc57bfe49 service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:55.744178 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e02c8f-db2f-4c87-b816-17bfc57bfe49 service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:55.744454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e02c8f-db2f-4c87-b816-17bfc57bfe49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:55.753800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e02c8f-db2f-4c87-b816-17bfc57bfe49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:55.755270 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e02c8f-db2f-4c87-b816-17bfc57bfe49 service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:55.765156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 736/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:10:58.054284 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9e4f-7a9c-4d20-a705-c58cc113e005 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:58.054843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9e4f-7a9c-4d20-a705-c58cc113e005 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:58.054843 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9e4f-7a9c-4d20-a705-c58cc113e005 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:58.056132 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 740/1476] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:10:58.061570 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774451e-4b0d-4c84-9b8e-34592ee73998 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:58.062050 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774451e-4b0d-4c84-9b8e-34592ee73998 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:58.062156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774451e-4b0d-4c84-9b8e-34592ee73998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:58.080226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e774451e-4b0d-4c84-9b8e-34592ee73998 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:10:58.081435 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e774451e-4b0d-4c84-9b8e-34592ee73998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:10:58.090143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 737/1477] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:10:58.112611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b9e4f-7a9c-4d20-a705-c58cc113e005 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:10:58.125435 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b9e4f-7a9c-4d20-a705-c58cc113e005 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:10:58.129812 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:10:58.130489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:10:58.130769 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:10:58.131042 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:10:58.131771 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:10:58.133541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 09:10:58.133541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 24 09:10:58.133541 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: May 24 09:10:58.134706 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69debc-a0c2-415b-8956-240b10518b20 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:10:58.154784 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 741/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Tue May 24 09:10:58 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:11:00.348182 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99c23-942d-4bea-afe1-604c9fa97ef5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:00.348726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99c23-942d-4bea-afe1-604c9fa97ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:00.348726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e99c23-942d-4bea-afe1-604c9fa97ef5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:00.350117 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 738/1479] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:11:00.355886 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ade33-7278-4e88-a473-0bc3b7d3c1eb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:00.356341 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ade33-7278-4e88-a473-0bc3b7d3c1eb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:00.356441 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ade33-7278-4e88-a473-0bc3b7d3c1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:00.374527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8e5ade33-7278-4e88-a473-0bc3b7d3c1eb None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:11:00.375737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8e5ade33-7278-4e88-a473-0bc3b7d3c1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:11:00.383358 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 742/1480] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:11:00.425627 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e99c23-942d-4bea-afe1-604c9fa97ef5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:11:00.440639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e99c23-942d-4bea-afe1-604c9fa97ef5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:11:00.445875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169224-4b6d-4211-ac06-294b0a945ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:11:00.446522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169224-4b6d-4211-ac06-294b0a945ab9 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:00.446815 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169224-4b6d-4211-ac06-294b0a945ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:00.447074 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169224-4b6d-4211-ac06-294b0a945ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:00.455631 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169224-4b6d-4211-ac06-294b0a945ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:11:00.457203 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169224-4b6d-4211-ac06-294b0a945ab9 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:11:00.466947 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 739/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:11:02.853383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1292-c7bc-4f8f-87d2-ea52848ee08c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:02.853966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1292-c7bc-4f8f-87d2-ea52848ee08c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:02.853966 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1292-c7bc-4f8f-87d2-ea52848ee08c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:02.855890 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 743/1482] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:11:02.861195 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b9e4-b7ef-4ec7-849e-489968f31051 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:02.861647 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b9e4-b7ef-4ec7-849e-489968f31051 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:02.861745 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0b9e4-b7ef-4ec7-849e-489968f31051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:02.879338 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-08b0b9e4-b7ef-4ec7-849e-489968f31051 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:11:02.880533 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-08b0b9e4-b7ef-4ec7-849e-489968f31051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:11:02.888961 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 740/1483] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:11:02.925216 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1292-c7bc-4f8f-87d2-ea52848ee08c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:11:02.936338 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1292-c7bc-4f8f-87d2-ea52848ee08c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:11:02.939782 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af5f18-b0e0-4d55-9321-e39d3363618e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:11:02.940414 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5f18-b0e0-4d55-9321-e39d3363618e service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:02.940720 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5f18-b0e0-4d55-9321-e39d3363618e service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:02.940996 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5f18-b0e0-4d55-9321-e39d3363618e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:02.950402 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af5f18-b0e0-4d55-9321-e39d3363618e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:11:02.951873 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af5f18-b0e0-4d55-9321-e39d3363618e service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:11:02.961033 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 744/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:11:05.205432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1c1d-4814-47a3-83f3-fbfe021e4390 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:05.206063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1c1d-4814-47a3-83f3-fbfe021e4390 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:05.206063 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f1c1d-4814-47a3-83f3-fbfe021e4390 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:05.207439 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 741/1485] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:11:05.212611 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d154a-f572-40b1-806a-25a36d601830 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:05.213068 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d154a-f572-40b1-806a-25a36d601830 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:05.213172 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d154a-f572-40b1-806a-25a36d601830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:05.232008 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-895d154a-f572-40b1-806a-25a36d601830 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:11:05.233174 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-895d154a-f572-40b1-806a-25a36d601830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:11:05.241347 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 745/1486] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:11:05.278964 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1c1d-4814-47a3-83f3-fbfe021e4390 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:11:05.289606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f1c1d-4814-47a3-83f3-fbfe021e4390 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:11:05.294689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a93ad-784a-42e3-85ef-8df275f49027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:11:05.295316 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a93ad-784a-42e3-85ef-8df275f49027 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:05.295592 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a93ad-784a-42e3-85ef-8df275f49027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:05.295860 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a93ad-784a-42e3-85ef-8df275f49027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:05.304719 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a93ad-784a-42e3-85ef-8df275f49027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:11:05.306175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a93ad-784a-42e3-85ef-8df275f49027 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:11:05.316006 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 742/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:11:07.670958 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f1ad-6eeb-4f73-82e3-d53ac242e2ba None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:07.671628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f1ad-6eeb-4f73-82e3-d53ac242e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:07.671628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f1ad-6eeb-4f73-82e3-d53ac242e2ba None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:07.672867 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 746/1488] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:11:07.678103 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561910-e302-4110-a9e6-963f6e9bc459 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:07.678586 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561910-e302-4110-a9e6-963f6e9bc459 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:07.678695 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561910-e302-4110-a9e6-963f6e9bc459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:07.695996 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2f561910-e302-4110-a9e6-963f6e9bc459 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:11:07.697233 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2f561910-e302-4110-a9e6-963f6e9bc459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:11:07.705127 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 743/1489] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:11:07.746021 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f1ad-6eeb-4f73-82e3-d53ac242e2ba None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:11:07.756836 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127f1ad-6eeb-4f73-82e3-d53ac242e2ba None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:11:07.760413 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee33917-bc02-4be2-840d-d6d3369dbb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:11:07.761053 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee33917-bc02-4be2-840d-d6d3369dbb50 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:07.761337 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee33917-bc02-4be2-840d-d6d3369dbb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:07.761617 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee33917-bc02-4be2-840d-d6d3369dbb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:07.770427 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee33917-bc02-4be2-840d-d6d3369dbb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:11:07.771862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee33917-bc02-4be2-840d-d6d3369dbb50 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:11:07.781792 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 747/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:11:10.152321 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceba35-2f83-4b6d-a8a7-fb85fe30a72d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:10.152853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceba35-2f83-4b6d-a8a7-fb85fe30a72d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:10.152853 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceba35-2f83-4b6d-a8a7-fb85fe30a72d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:10.154207 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 744/1491] 10.222.0.30 () {54 vars in 926 bytes} [Tue May 24 09:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:11:10.159496 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0799078-27cb-4e9e-82e0-0992ab681c93 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:10.159970 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0799078-27cb-4e9e-82e0-0992ab681c93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:10.160080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0799078-27cb-4e9e-82e0-0992ab681c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:10.178458 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a0799078-27cb-4e9e-82e0-0992ab681c93 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:11:10.179658 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a0799078-27cb-4e9e-82e0-0992ab681c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:11:10.188030 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 748/1492] 10.222.0.30 () {58 vars in 1023 bytes} [Tue May 24 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 09:11:10.225591 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceba35-2f83-4b6d-a8a7-fb85fe30a72d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:11:10.236849 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceba35-2f83-4b6d-a8a7-fb85fe30a72d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:11:10.240417 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff6fc-d564-40db-803b-db5fae1bec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:11:10.241072 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff6fc-d564-40db-803b-db5fae1bec3b service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:11:10.241352 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff6fc-d564-40db-803b-db5fae1bec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:11:10.241625 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff6fc-d564-40db-803b-db5fae1bec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:11:10.251671 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff6fc-d564-40db-803b-db5fae1bec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:11:10.253096 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff6fc-d564-40db-803b-db5fae1bec3b service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:11:10.262472 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 745/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:11:20.173320 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=33 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:11:20.258235 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=33 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:12:50.001669 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.002293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.002293 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.020534 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:12:50.021716 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:50.030067 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 749/1494] 10.222.0.30 () {58 vars in 957 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:12:50.039568 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.040068 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.040156 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.057974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:12:50.059138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:50.067033 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 746/1495] 10.222.0.30 () {58 vars in 957 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:12:50.072361 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.082040 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b09e28-e3e4-4a9c-aca0-aaa907010682 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.087332 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.087985 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.088268 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.088544 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.089262 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:12:50.089567 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.090629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.090629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 24 09:12:50.090629 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: May 24 09:12:50.091508 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.103321 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 750/1496] 10.222.0.30 () {58 vars in 1152 bytes} [Tue May 24 09:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:12:50.111473 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.120665 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b7c8e-a68b-46c3-8ea8-3c70c030023d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.125231 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.125882 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.126206 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.126487 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.127175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.128995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.128995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: warnings.warn(msg) May 24 09:12:50.128995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: May 24 09:12:50.130226 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.168143 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 747/1497] 10.222.0.30 () {60 vars in 1152 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:12:50.172454 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.183150 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4eb84-1eb5-4b4c-9cf8-e67fdf01e69e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.240327 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.241052 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.241340 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.241646 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.242933 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.244014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.244014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 24 09:12:50.244014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: May 24 09:12:50.245211 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.265703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 751/1498] 10.222.0.30 () {60 vars in 1143 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:12:50.269794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.280302 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e45ccc-535a-4018-bd9d-58be4495732c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.284709 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.285358 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.285639 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.285967 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.286688 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.287689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.287689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: warnings.warn(msg) May 24 09:12:50.287689 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: May 24 09:12:50.288946 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.301664 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 748/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Tue May 24 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:12:50.306130 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.316014 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca5850-a398-45ce-afb6-ce6c0aa0a275 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.321416 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.322109 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.322398 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.322681 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.323405 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.324423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.324423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 24 09:12:50.324423 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: May 24 09:12:50.325310 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309c002-50a1-4914-a2da-9a8f67be6aa6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.338479 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 752/1500] 10.222.0.30 () {58 vars in 1121 bytes} [Tue May 24 09:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 09:12:50.342454 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.352505 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050418e-7a0c-4c15-a127-b2b533351027 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.357009 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.357875 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.358194 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.358476 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] PATH_INFO: `/v3/projects/af8fe00a395e4302a093174a5c37f9f5/users/6220b0c08d7445bfb3f546b286dfe5aa/roles/e11d9924ba394c088bd2aee20d352866` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.373357 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8fe00a395e4302a093174a5c37f9f5, user_id=6220b0c08d7445bfb3f546b286dfe5aa, role_id=e11d9924ba394c088bd2aee20d352866)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.374438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.374438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: warnings.warn(msg) May 24 09:12:50.374438 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: May 24 09:12:50.376373 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aed2e-4b60-4633-98e1-b26c385d2ce3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.389707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 749/1501] 10.222.0.30 () {60 vars in 1482 bytes} [Tue May 24 09:12:50 2022] PUT /identity/v3/projects/af8fe00a395e4302a093174a5c37f9f5/users/6220b0c08d7445bfb3f546b286dfe5aa/roles/e11d9924ba394c088bd2aee20d352866 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:12:50.400881 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd04d-5102-4b31-b904-915f68026be4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.401205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd04d-5102-4b31-b904-915f68026be4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.401491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dd04d-5102-4b31-b904-915f68026be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.427973 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9c2dd04d-5102-4b31-b904-915f68026be4 None None] MFA Rules not processed for user `6220b0c08d7445bfb3f546b286dfe5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:12:50.429176 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9c2dd04d-5102-4b31-b904-915f68026be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:50.491202 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 753/1502] 10.222.0.30 () {58 vars in 957 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:12:50.504653 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05013-a7cb-42da-8945-e7ba63036706 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.504968 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05013-a7cb-42da-8945-e7ba63036706 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.505248 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05013-a7cb-42da-8945-e7ba63036706 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.506649 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 750/1503] 10.222.0.30 () {54 vars in 963 bytes} [Tue May 24 09:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:12:50.511868 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0bf7-17be-4ced-a1ed-28b053f9cac8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.512161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0bf7-17be-4ced-a1ed-28b053f9cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.512444 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e0bf7-17be-4ced-a1ed-28b053f9cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.530175 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cd3e0bf7-17be-4ced-a1ed-28b053f9cac8 None None] MFA Rules not processed for user `cccb32a47f7d4144b224d9fcc99091e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:12:50.531356 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cd3e0bf7-17be-4ced-a1ed-28b053f9cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:50.575748 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:12:50.585239 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 754/1504] 10.222.0.30 () {58 vars in 1060 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:12:50.593288 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d05013-a7cb-42da-8945-e7ba63036706 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.604443 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d05013-a7cb-42da-8945-e7ba63036706 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.607984 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cccb32a47f7d4144b224d9fcc99091e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.608618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.608904 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.609179 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.618075 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.619539 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.628278 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 751/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:12:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:12:50.669796 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230374a3-81cf-478c-8cf7-2f801e9c3f5a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.670140 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230374a3-81cf-478c-8cf7-2f801e9c3f5a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.670426 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230374a3-81cf-478c-8cf7-2f801e9c3f5a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.671738 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 755/1506] 10.222.0.30 () {52 vars in 829 bytes} [Tue May 24 09:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:12:50.675385 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.738651 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bef51-d804-4117-98ab-12015c2f9627 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:50.743974 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:50.744847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.745131 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.745405 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] PATH_INFO: `/v3/users/6220b0c08d7445bfb3f546b286dfe5aa` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.746606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6220b0c08d7445bfb3f546b286dfe5aa)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:50.747654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:50.747654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: warnings.warn(msg) May 24 09:12:50.747654 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: May 24 09:12:50.748847 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:50.815881 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6220b0c08d7445bfb3f546b286dfe5aa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:50.829139 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6220b0c08d7445bfb3f546b286dfe5aa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:50.829843 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6220b0c08d7445bfb3f546b286dfe5aa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:50.848421 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6220b0c08d7445bfb3f546b286dfe5aa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:50.852707 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:12:50.858803 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6220b0c08d7445bfb3f546b286dfe5aa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:50.866356 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 752/1507] 10.222.0.30 () {58 vars in 1223 bytes} [Tue May 24 09:12:50 2022] DELETE /identity/v3/users/6220b0c08d7445bfb3f546b286dfe5aa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:12:50.870941 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:50.871229 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:50.871503 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:50.889080 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:12:50.890300 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:50.948090 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 756/1508] 10.222.0.30 () {58 vars in 957 bytes} [Tue May 24 09:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:12:50.957393 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:50.958822 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:51.015738 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec252-d7a8-4fe0-a908-b1b9bd3a48a1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:51.019396 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65df386-8b92-4654-a635-26a37b3f2bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:51.020040 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65df386-8b92-4654-a635-26a37b3f2bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:51.020328 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65df386-8b92-4654-a635-26a37b3f2bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:51.020606 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65df386-8b92-4654-a635-26a37b3f2bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:51.029950 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65df386-8b92-4654-a635-26a37b3f2bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:51.031404 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65df386-8b92-4654-a635-26a37b3f2bd9 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:51.040995 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 753/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:12:51.358999 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:12:51.360596 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:12:51.372803 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830440e9-9c52-4fff-99c2-8f2a67b47226 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:12:51.377761 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96d05461ca4045ab8fe2fd46023e1ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80c3bd13a3974d42b6d3ecb6e6bc1a06', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:12:51.378641 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:12:51.378972 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:12:51.379197 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] PATH_INFO: `/v3/projects/af8fe00a395e4302a093174a5c37f9f5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:12:51.380654 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8fe00a395e4302a093174a5c37f9f5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:12:51.381683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 09:12:51.381683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 24 09:12:51.381683 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: May 24 09:12:51.383703 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:12:51.443768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8fe00a395e4302a093174a5c37f9f5', 'request_id': 'req-04465dd2-916c-49f5-93fb-fe65671d7e50'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:51.454597 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8fe00a395e4302a093174a5c37f9f5', 'request_id': 'req-04465dd2-916c-49f5-93fb-fe65671d7e50'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:51.469041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8fe00a395e4302a093174a5c37f9f5', 'request_id': 'req-04465dd2-916c-49f5-93fb-fe65671d7e50'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:51.480380 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] The token cache is being invalidate because project af8fe00a395e4302a093174a5c37f9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 09:12:51.480664 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:51.481298 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-04465dd2-916c-49f5-93fb-fe65671d7e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 09:12:51.482954 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 757/1510] 10.222.0.30 () {58 vars in 1232 bytes} [Tue May 24 09:12:51 2022] DELETE /identity/v3/projects/af8fe00a395e4302a093174a5c37f9f5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:13:01.036549 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:13:01.477022 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:14:30.868798 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7fab8-af67-4ec3-b7d8-3f2f4060a9a8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:30.869285 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7fab8-af67-4ec3-b7d8-3f2f4060a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:30.869383 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7fab8-af67-4ec3-b7d8-3f2f4060a9a8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:30.870792 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:30.875656 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65c0cb-7d62-4ba0-a2c1-ab0ab6b277c0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:30.876099 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65c0cb-7d62-4ba0-a2c1-ab0ab6b277c0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:30.876207 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65c0cb-7d62-4ba0-a2c1-ab0ab6b277c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:30.894267 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bc65c0cb-7d62-4ba0-a2c1-ab0ab6b277c0 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:30.896047 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bc65c0cb-7d62-4ba0-a2c1-ab0ab6b277c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:30.956789 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:31.126378 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7fab8-af67-4ec3-b7d8-3f2f4060a9a8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:31.128104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-abb7fab8-af67-4ec3-b7d8-3f2f4060a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:31.202520 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7fab8-af67-4ec3-b7d8-3f2f4060a9a8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:31.208502 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391a35c-010f-4427-8016-19261d7ef89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:31.209163 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391a35c-010f-4427-8016-19261d7ef89c service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:31.209447 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391a35c-010f-4427-8016-19261d7ef89c service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:31.209726 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391a35c-010f-4427-8016-19261d7ef89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:31.217855 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391a35c-010f-4427-8016-19261d7ef89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:31.219493 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391a35c-010f-4427-8016-19261d7ef89c service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:31.228921 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 755/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:32.099275 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a581a-e5c7-40e3-941c-51ae6cca77bb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:32.099830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a581a-e5c7-40e3-941c-51ae6cca77bb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:32.099830 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a581a-e5c7-40e3-941c-51ae6cca77bb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:32.101129 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:32.105764 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17665372-a0a0-407f-9fd4-5c250f7a5de9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:32.106212 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17665372-a0a0-407f-9fd4-5c250f7a5de9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:32.106363 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17665372-a0a0-407f-9fd4-5c250f7a5de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:32.124243 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-17665372-a0a0-407f-9fd4-5c250f7a5de9 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:32.125432 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-17665372-a0a0-407f-9fd4-5c250f7a5de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:32.134114 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:32.259167 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacfbca-f616-47df-8ad9-891d08a2c08d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:32.259489 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacfbca-f616-47df-8ad9-891d08a2c08d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:32.259872 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacfbca-f616-47df-8ad9-891d08a2c08d None None] PATH_INFO: `/v3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:32.261189 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 760/1516] 10.222.0.11 () {54 vars in 925 bytes} [Tue May 24 09:14:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:14:32.267359 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490c9fb-509f-48a0-8b04-a0e2b446c097 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:32.267650 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490c9fb-509f-48a0-8b04-a0e2b446c097 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:32.267931 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490c9fb-509f-48a0-8b04-a0e2b446c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:32.286301 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3490c9fb-509f-48a0-8b04-a0e2b446c097 None None] MFA Rules not processed for user `c279c9b085cf4ed29beb47b720834165`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:32.287736 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3490c9fb-509f-48a0-8b04-a0e2b446c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:32.287952 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacfbca-f616-47df-8ad9-891d08a2c08d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:32.302709 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacfbca-f616-47df-8ad9-891d08a2c08d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:32.308041 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa82a7-c308-450d-b540-d5288f037bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:32.308677 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa82a7-c308-450d-b540-d5288f037bd5 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:32.308967 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa82a7-c308-450d-b540-d5288f037bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:32.309246 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa82a7-c308-450d-b540-d5288f037bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:32.318128 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa82a7-c308-450d-b540-d5288f037bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:32.319744 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa82a7-c308-450d-b540-d5288f037bd5 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:32.330161 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 761/1517] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 09:14:32.352955 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 757/1518] 10.222.0.11 () {58 vars in 1015 bytes} [Tue May 24 09:14:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:41.099225 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07bfd-2ade-446c-8126-56e308666370 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:41.099737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07bfd-2ade-446c-8126-56e308666370 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:41.099737 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07bfd-2ade-446c-8126-56e308666370 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:41.101669 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 762/1519] 10.222.0.30 () {54 vars in 960 bytes} [Tue May 24 09:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:41.106605 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2507fa-a96b-4c6c-979f-d7470e0cd42c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:41.107167 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2507fa-a96b-4c6c-979f-d7470e0cd42c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:41.107514 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2507fa-a96b-4c6c-979f-d7470e0cd42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:41.125766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ac2507fa-a96b-4c6c-979f-d7470e0cd42c None None] MFA Rules not processed for user `c279c9b085cf4ed29beb47b720834165`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:41.127000 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ac2507fa-a96b-4c6c-979f-d7470e0cd42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:41.135506 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 758/1520] 10.222.0.30 () {58 vars in 1057 bytes} [Tue May 24 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:41.142916 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c07bfd-2ade-446c-8126-56e308666370 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:41.156743 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c07bfd-2ade-446c-8126-56e308666370 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:41.162074 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c03e7e-8da3-4729-9abf-15dd2891e60f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c279c9b085cf4ed29beb47b720834165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:41.163290 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c03e7e-8da3-4729-9abf-15dd2891e60f service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:41.163564 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c03e7e-8da3-4729-9abf-15dd2891e60f service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:41.163862 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c03e7e-8da3-4729-9abf-15dd2891e60f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:41.172241 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c03e7e-8da3-4729-9abf-15dd2891e60f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:41.173927 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c03e7e-8da3-4729-9abf-15dd2891e60f service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:41.183682 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 763/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:43.604222 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819af01-5923-404e-a152-509e6655e7a1 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:43.604794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819af01-5923-404e-a152-509e6655e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:43.604794 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819af01-5923-404e-a152-509e6655e7a1 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:43.606188 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:43.611125 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e9b51-94d5-4aed-ba33-e55717671ca0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:43.611593 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e9b51-94d5-4aed-ba33-e55717671ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:43.611692 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e9b51-94d5-4aed-ba33-e55717671ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:43.630071 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-045e9b51-94d5-4aed-ba33-e55717671ca0 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:43.631911 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-045e9b51-94d5-4aed-ba33-e55717671ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:43.639638 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:43.793522 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819af01-5923-404e-a152-509e6655e7a1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:43.809873 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819af01-5923-404e-a152-509e6655e7a1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:43.815104 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f98995-248f-4dc9-ac39-4c141f3da9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:43.815735 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98995-248f-4dc9-ac39-4c141f3da9d4 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:43.816017 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98995-248f-4dc9-ac39-4c141f3da9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:43.816289 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f98995-248f-4dc9-ac39-4c141f3da9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:43.824340 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f98995-248f-4dc9-ac39-4c141f3da9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:43.825938 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f98995-248f-4dc9-ac39-4c141f3da9d4 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:43.835247 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 760/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:44.694586 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3168b-4435-4ecb-89db-9151d096122b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:44.695018 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3168b-4435-4ecb-89db-9151d096122b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:44.695144 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3168b-4435-4ecb-89db-9151d096122b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:44.696542 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 09:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:44.701245 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3fe7-2588-414d-969d-4cd5688938db None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:44.701677 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3fe7-2588-414d-969d-4cd5688938db None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:44.701832 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3fe7-2588-414d-969d-4cd5688938db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:44.721917 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-eaaa3fe7-2588-414d-969d-4cd5688938db None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:44.723150 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eaaa3fe7-2588-414d-969d-4cd5688938db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:44.731013 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 09:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:44.884366 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3168b-4435-4ecb-89db-9151d096122b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:44.898956 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3168b-4435-4ecb-89db-9151d096122b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:44.904289 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97696a48-6a44-47b5-a9b1-d93cb0982e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba53ef4d604f33aa31e50d053f3641', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:44.904939 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97696a48-6a44-47b5-a9b1-d93cb0982e57 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:44.905205 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97696a48-6a44-47b5-a9b1-d93cb0982e57 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:44.905491 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97696a48-6a44-47b5-a9b1-d93cb0982e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:44.914089 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97696a48-6a44-47b5-a9b1-d93cb0982e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:44.915671 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97696a48-6a44-47b5-a9b1-d93cb0982e57 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:44.924929 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 766/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:49.321138 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722631c1-d80c-46e6-80d9-7e3d252c906e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:49.321746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722631c1-d80c-46e6-80d9-7e3d252c906e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:49.321746 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722631c1-d80c-46e6-80d9-7e3d252c906e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:49.323083 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:49.328078 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b71fe-4b47-4d9d-911d-bd6c8f18eee6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:49.328525 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b71fe-4b47-4d9d-911d-bd6c8f18eee6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:49.328628 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b71fe-4b47-4d9d-911d-bd6c8f18eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:49.346719 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e83b71fe-4b47-4d9d-911d-bd6c8f18eee6 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:49.347908 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e83b71fe-4b47-4d9d-911d-bd6c8f18eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:49.356673 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:49.393105 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722631c1-d80c-46e6-80d9-7e3d252c906e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:49.394789 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-722631c1-d80c-46e6-80d9-7e3d252c906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:49.447011 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:14:49.451490 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722631c1-d80c-46e6-80d9-7e3d252c906e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:49.455007 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db55ce-bc07-449e-9fb5-7f0752a106d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:49.455646 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db55ce-bc07-449e-9fb5-7f0752a106d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:49.455933 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db55ce-bc07-449e-9fb5-7f0752a106d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:49.456208 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db55ce-bc07-449e-9fb5-7f0752a106d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:49.465618 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db55ce-bc07-449e-9fb5-7f0752a106d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:49.467110 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db55ce-bc07-449e-9fb5-7f0752a106d7 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:49.476894 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 763/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:51.666155 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4fc7a-cb21-49a3-8a5f-bd72ff4257f4 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:51.666759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4fc7a-cb21-49a3-8a5f-bd72ff4257f4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:51.666759 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4fc7a-cb21-49a3-8a5f-bd72ff4257f4 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:51.668063 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:51.673202 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e10c-5456-4828-9f85-1103c870a907 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:51.673607 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e10c-5456-4828-9f85-1103c870a907 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:51.673766 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e10c-5456-4828-9f85-1103c870a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:51.691431 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-78e2e10c-5456-4828-9f85-1103c870a907 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:51.692622 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-78e2e10c-5456-4828-9f85-1103c870a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:51.700489 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:51.736711 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4fc7a-cb21-49a3-8a5f-bd72ff4257f4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:51.742624 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=52 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:14:51.748829 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4fc7a-cb21-49a3-8a5f-bd72ff4257f4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:51.752308 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a822cc-90b7-40a9-9ece-940e0af0c123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '061ff7358d4e45cdaaa15196aef8c4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:51.752957 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a822cc-90b7-40a9-9ece-940e0af0c123 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:51.753238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a822cc-90b7-40a9-9ece-940e0af0c123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:51.753512 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a822cc-90b7-40a9-9ece-940e0af0c123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:51.762725 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a822cc-90b7-40a9-9ece-940e0af0c123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:51.764157 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a822cc-90b7-40a9-9ece-940e0af0c123 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:51.774325 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 769/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:55.594672 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5a13a-a0b1-406c-a1ce-7980e8b6bbad None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:55.595260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5a13a-a0b1-406c-a1ce-7980e8b6bbad None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:55.595260 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5a13a-a0b1-406c-a1ce-7980e8b6bbad None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:55.596641 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:55.602651 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e005-f155-4ba8-a398-84a3b38531ab None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:55.603106 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e005-f155-4ba8-a398-84a3b38531ab None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:55.603238 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2e005-f155-4ba8-a398-84a3b38531ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:55.621799 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f6f2e005-f155-4ba8-a398-84a3b38531ab None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:55.623039 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f6f2e005-f155-4ba8-a398-84a3b38531ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:55.631045 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:55.904370 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5a13a-a0b1-406c-a1ce-7980e8b6bbad None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:55.906092 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-08f5a13a-a0b1-406c-a1ce-7980e8b6bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:55.962118 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5a13a-a0b1-406c-a1ce-7980e8b6bbad None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:55.965617 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9533c7d-cc6b-4f90-8e3f-02f13a5e43d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cccb32a47f7d4144b224d9fcc99091e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:55.966284 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533c7d-cc6b-4f90-8e3f-02f13a5e43d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:55.966569 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533c7d-cc6b-4f90-8e3f-02f13a5e43d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:55.966848 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9533c7d-cc6b-4f90-8e3f-02f13a5e43d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:55.976091 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9533c7d-cc6b-4f90-8e3f-02f13a5e43d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:55.977525 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9533c7d-cc6b-4f90-8e3f-02f13a5e43d9 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:55.986800 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 766/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:14:58.197336 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1d4b-a6eb-479e-af02-618c2ac3dcbb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:58.197887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1d4b-a6eb-479e-af02-618c2ac3dcbb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:58.197887 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d1d4b-a6eb-479e-af02-618c2ac3dcbb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:58.199301 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 09:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:14:58.204626 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127363e6-fc3b-4226-9ef9-9d5625731465 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:58.205064 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127363e6-fc3b-4226-9ef9-9d5625731465 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:58.205175 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127363e6-fc3b-4226-9ef9-9d5625731465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:58.225448 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-127363e6-fc3b-4226-9ef9-9d5625731465 None None] MFA Rules not processed for user `96d05461ca4045ab8fe2fd46023e1ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:14:58.226424 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-127363e6-fc3b-4226-9ef9-9d5625731465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:58.234204 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 09:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 09:14:58.505639 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d1d4b-a6eb-479e-af02-618c2ac3dcbb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:14:58.507392 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-676d1d4b-a6eb-479e-af02-618c2ac3dcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:14:58.520448 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d1d4b-a6eb-479e-af02-618c2ac3dcbb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:14:58.524635 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375a376-cea7-4f15-97c3-a8f43be54542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cccb32a47f7d4144b224d9fcc99091e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e224b74e66e14412b90d6324fe534a94', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:14:58.525274 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a376-cea7-4f15-97c3-a8f43be54542 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:14:58.525560 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a376-cea7-4f15-97c3-a8f43be54542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:14:58.525838 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a376-cea7-4f15-97c3-a8f43be54542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:14:58.534768 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a376-cea7-4f15-97c3-a8f43be54542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:14:58.536201 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a376-cea7-4f15-97c3-a8f43be54542 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:14:58.546527 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 772/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Tue May 24 09:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 09:15:08.218870 dv-cinder-843118-1-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=36 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:15:08.542383 dv-cinder-843118-1-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=14 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}